-- Logs begin at Thu 2022-01-27 15:19:48 UTC, end at Thu 2022-01-27 16:29:16 UTC. -- Jan 27 15:54:29.924498 dv-cinder-826350-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 27 15:54:29.931835 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 27 15:54:29.933800 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jan 27 15:54:29 2022] *** Jan 27 15:54:29.933800 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 27 15:54:29.933800 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 27 15:54:29.933800 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: nodename: dv-cinder-826350-3-iscsi Jan 27 15:54:29.933800 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: machine: x86_64 Jan 27 15:54:29.933800 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: clock source: unix Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: pcre jit disabled Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: detected number of CPU cores: 4 Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: current working directory: / Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: detected binary path: /usr/bin/uwsgi-core Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: your processes number limit is 47680 Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: your memory page size is 4096 bytes Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: detected max file descriptor number: 2048 Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: lock engine: pthread robust mutexes Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: thunder lock: enabled Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 27 15:54:29.934213 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 27 15:54:29.980352 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: Python main interpreter initialized at 0x559f46c679c0 Jan 27 15:54:29.980352 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: python threads support enabled Jan 27 15:54:29.980352 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: your server socket listen backlog is limited to 100 connections Jan 27 15:54:29.980352 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: your mercy for graceful operations on workers is 90 seconds Jan 27 15:54:29.980725 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: mapped 403077 bytes (393 KB) for 2 cores Jan 27 15:54:29.980801 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: *** Operational MODE: preforking *** Jan 27 15:54:29.981041 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: *** uWSGI is running in multiple interpreter mode *** Jan 27 15:54:29.981041 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: spawned uWSGI master process (pid: 101644) Jan 27 15:54:29.981231 dv-cinder-826350-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 27 15:54:29.981890 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: spawned uWSGI worker 1 (pid: 101645, cores: 1) Jan 27 15:54:29.982124 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: spawned uWSGI worker 2 (pid: 101646, cores: 1) Jan 27 15:54:29.982309 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 27 15:54:31.765892 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 15:54:31.765892 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: from cryptography.utils import int_from_bytes Jan 27 15:54:31.766560 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 15:54:31.766560 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: from cryptography.utils import int_from_bytes Jan 27 15:54:31.772088 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 15:54:31.772088 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: from cryptography.utils import int_from_bytes Jan 27 15:54:31.772591 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 15:54:31.772591 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: from cryptography.utils import int_from_bytes Jan 27 15:54:34.386715 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 15:54:34.387331 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 15:54:34.387421 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 15:54:34.387421 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 15:54:34.387861 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 15:54:34.387943 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 15:54:34.388018 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 15:54:34.388107 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 15:54:34.388197 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 15:54:34.388365 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 15:54:34.388457 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.388759 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.388857 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.389092 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.389177 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.389418 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.389501 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.389766 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.389866 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.390091 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.390195 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.390413 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.390505 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.390734 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.390829 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.391084 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.391171 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.391351 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.391436 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.391674 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.391759 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.391994 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.392076 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-3-iscsi {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.392317 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.392400 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-3-iscsi {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.392629 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.392767 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.392943 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.393036 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.393262 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.393347 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.393575 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.393665 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.393890 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.393971 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.394207 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.394298 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.394519 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.394706 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.395053 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.395217 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.395375 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.395489 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.395687 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.395808 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.396003 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.396143 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.396344 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.396432 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.396668 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.396754 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.396984 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.397078 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.397311 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.397409 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.397627 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.397716 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.397937 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.398024 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.398256 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.398339 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-3-iscsi {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.398648 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.398729 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-3-iscsi {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.398968 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.399072 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.399311 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.399414 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.399634 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.399727 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.400026 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.400122 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.400350 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.400488 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.400673 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.400772 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.400976 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.401096 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.401287 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.401398 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.401619 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.401722 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.401939 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.402038 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.402259 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.402356 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.402581 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.402670 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.402888 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.403009 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.403230 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.403329 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.403548 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.403638 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.403858 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.403956 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.404167 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.404254 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.404475 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.404586 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.404734 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.404837 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.405021 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.405107 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.405335 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.405930 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.406196 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.406330 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.406521 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.406606 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.406783 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.406890 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.407063 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.407217 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.407366 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.407461 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.407690 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.407776 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.408001 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.408085 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.408317 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.408401 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.408630 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.408714 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.408938 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.409029 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.409247 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.409386 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.409554 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.409646 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.409861 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.409950 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.410171 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.410267 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.410482 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.410578 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.410800 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.410883 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.411144 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.411244 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.411459 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.411543 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.411775 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.411863 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.412099 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.412193 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.412417 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.412509 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.412731 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.412823 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.413047 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.413139 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.413388 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.413478 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.413703 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.413787 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.414018 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.414109 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.414341 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.414433 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.414668 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.414799 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.414964 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.415069 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.415297 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.415385 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.415608 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.415697 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.415934 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.416019 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.416241 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.416326 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.416496 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.416582 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.416804 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.416940 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.417108 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.417201 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.417420 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.417505 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.417733 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.417817 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.418043 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.418127 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.418353 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.418444 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.418659 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.418751 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.418996 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.419084 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.419299 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.419394 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.419609 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.419701 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.419917 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.420002 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.420227 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.420320 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.420536 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.420639 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.420844 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.420932 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.421226 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.421838 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.422041 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.422130 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.422356 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.422444 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.422680 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.422776 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.423015 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.423105 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.423326 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.423415 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.423639 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.423735 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.423950 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.424044 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.424264 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.424365 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.424573 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.424669 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.424884 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.424980 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.425193 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.425280 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.425504 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.425600 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.425815 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.425903 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.426128 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.426216 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.426436 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.426524 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.426747 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.426835 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.427086 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.427188 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.427395 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.427496 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.427700 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.427793 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.428014 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.428101 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.428323 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.428415 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.428632 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.428717 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.428939 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.429030 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.429245 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.429329 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.429551 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.429633 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.429857 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.429941 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.430162 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.430254 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.430469 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.430551 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.430773 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.430878 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.431098 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.431186 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.431422 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.431506 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.431735 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.431831 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.432050 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.432133 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.432361 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.432444 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.432670 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.432765 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.432994 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 15:54:34.433086 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.433333 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.433425 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.433675 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.433767 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.433997 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.434079 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.434326 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.434415 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.434662 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.434746 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.434998 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.435096 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.435329 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.435412 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.435648 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.435740 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.435964 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.436056 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.436285 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.436377 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.436600 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.437269 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.437439 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.437522 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.437757 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.437849 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.438079 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.438162 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.438401 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.438483 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.438725 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.438823 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.439071 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.439159 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.439400 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.439485 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.439717 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.439812 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.440034 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.440118 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.440358 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.440450 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.440684 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.440791 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.441005 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.441102 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.441316 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.441415 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.441664 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.441762 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.441991 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.442074 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.442315 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.442399 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.442632 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.442727 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.442950 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.443087 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.443291 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.443382 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.443612 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.443698 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.443928 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.444019 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.444247 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.444331 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.444572 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.444665 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.444886 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.444969 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.445204 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.445300 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.445532 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.445616 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.445850 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.445934 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.446160 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.446245 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.446472 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.446556 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.446781 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.446863 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.447114 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.447214 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.447425 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.447517 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.447734 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.447824 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.448060 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.448153 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.448374 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.448459 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.448694 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.448778 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.449014 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.449105 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.449332 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.449415 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.449645 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.449727 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.449960 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.450054 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.450271 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.450360 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.450580 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.450662 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.450893 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.451095 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.451229 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.451314 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.451540 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.451622 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.451859 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.451948 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.452165 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.452312 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.453040 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.453127 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.453361 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.453480 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.453715 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.453808 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.454032 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.454118 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.454353 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.454445 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.454673 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.454758 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.455017 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.455158 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.455349 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.455437 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.455662 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.455751 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.455982 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.456080 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.456299 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.456387 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.456641 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.456736 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.456948 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.457044 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.457278 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.457365 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.457607 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.457704 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.457927 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.458026 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.458239 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.458331 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.458548 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.458630 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.458855 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.458939 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.459191 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.459286 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.459501 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.459585 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.459813 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.459942 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.460121 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.460204 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.460427 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.460510 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.460734 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.460825 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.461041 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.461138 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.461347 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.461444 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.461652 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.461737 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.461975 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.462058 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.462286 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.462381 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.462593 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.462677 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.462899 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.463049 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.463232 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.463328 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.463568 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.463651 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.463882 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.463965 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.464231 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.464323 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.464551 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.464635 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.464880 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.464972 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.465218 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.465361 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.465520 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.465605 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.465833 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.465917 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.466150 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.466236 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.466466 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.466551 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.466781 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.466864 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.467126 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.467215 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.467441 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.467524 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.467759 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.467876 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.468100 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.468187 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.468420 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.468503 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.468732 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.468815 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.469055 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.469147 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.469363 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.469447 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.469680 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.469770 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.470003 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.470089 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.470342 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.470425 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.470666 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.470762 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.471017 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.471103 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.471421 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.471520 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.471641 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.471749 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.471959 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.472045 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.472271 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.472363 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.472585 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.472699 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.472902 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.472988 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.473220 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.473305 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.473533 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.473625 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.473855 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.473938 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.474173 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.474263 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.474488 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.474579 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.474808 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.474911 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.475147 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.475237 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.475460 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.475560 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.475769 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.475853 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.476092 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.476176 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.476426 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.476512 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.476739 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.476846 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.477060 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.477147 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.477375 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.477467 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.477690 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.477825 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.478005 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.478089 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.478316 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.478407 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.478624 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.478707 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.478933 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.479073 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.479272 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.479356 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.479590 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.479675 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.479902 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.479994 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.480217 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.480307 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.480523 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.480605 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.480831 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.481003 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.481140 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.481223 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.481469 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.481601 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.481757 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.481854 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.482067 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.482151 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.482386 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.482471 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.482699 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.482783 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.483037 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.483136 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.483366 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.483469 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.483714 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.483807 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.484030 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.484113 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.484342 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.484474 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.484657 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.484741 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.484967 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.485104 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.485273 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.485363 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.485581 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.485678 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.485884 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.485967 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.486228 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.486319 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.486539 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.486631 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.486846 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.486930 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.487196 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.487295 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.487510 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.487594 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.487823 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.487905 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.488138 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.488231 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.488452 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.488534 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.488768 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.488852 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.489087 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.489178 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.489403 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.489487 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.489714 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.489797 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.490028 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.490112 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.490341 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.490424 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.490656 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.490745 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.490970 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.491072 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.491313 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.491394 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.491627 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.491708 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.491941 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.492026 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.492253 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.492337 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.492564 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.492648 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.492879 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.492971 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.493201 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.493453 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.493770 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.493868 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.494105 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.494188 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.494423 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.494506 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.494747 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.494838 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.495096 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.495183 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.495422 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.495506 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.495757 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.495862 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.496077 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.496164 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.496390 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.496474 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.496698 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.496789 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.497010 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.497094 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.497320 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.497404 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.497634 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.497719 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.497943 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.498025 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.498253 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.498337 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.498562 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.498646 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.498869 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.498951 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.499769 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.499860 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.500090 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.500194 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.500427 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.500535 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.500738 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.500824 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.501048 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.501149 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.501356 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.501441 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.501669 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.501751 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.501977 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.502069 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.502288 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.502373 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.502606 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.502690 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.502917 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.503032 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.503255 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.503344 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.503820 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.503911 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.504141 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.504226 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.504466 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.504555 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.504794 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.504877 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.505128 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.505261 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.505462 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.505554 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.505771 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.505864 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.506081 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.506244 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.506410 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.506505 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.506718 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.506801 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.507050 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.507152 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.507363 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.507448 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.507673 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.507757 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.507985 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.508123 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.508294 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.508381 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.508602 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.508686 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.508915 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.509006 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.509231 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.509314 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.509542 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.509625 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.509852 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.509937 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.510163 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.510265 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.510471 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.510609 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.510778 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.510869 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.511112 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.511208 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.511424 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.511510 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.511734 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.511818 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.512046 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.512131 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.512357 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.512448 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.512665 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.512750 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.512974 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.513057 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.513278 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.513375 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.513588 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.513671 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.513895 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.513977 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.514205 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.514301 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.514513 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.514605 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.515396 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.515491 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.515711 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.515812 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.516023 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.516108 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.516351 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.516442 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.516671 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.516758 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.516982 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.517066 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.517293 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.517384 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.517603 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.517687 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.517913 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.517997 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.518222 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.518304 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.518534 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.518626 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.518852 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.518936 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.519198 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.519293 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.519512 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.519597 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.519819 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.519909 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.520127 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.520247 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.520434 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.520522 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.520742 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.520826 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.521049 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.521141 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.521355 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.521441 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.521661 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.521751 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.521966 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.522058 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.522273 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.522357 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.522578 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.522661 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.522884 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.523007 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.523232 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.523316 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.523541 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.523625 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.523847 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.523932 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.524153 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.524236 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.524462 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.524546 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.524804 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.524895 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.525111 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.525193 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.525465 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.525594 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.525776 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.525866 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.526098 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.526189 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.526413 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.526496 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.526726 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.526811 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.527064 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.527150 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.527378 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.527479 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.527684 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.527774 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.528000 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.528091 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.528313 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.528409 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.528620 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.528703 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.528929 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.529019 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.529240 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.529337 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.529556 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.529640 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.529870 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.529952 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.530185 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.530282 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.530539 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.530624 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.530868 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.530953 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.531204 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.531302 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.531520 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.531604 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.531833 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.531915 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.532147 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.532231 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.532459 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.532549 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.532768 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.532858 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.533083 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.533167 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.533398 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.533488 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.533712 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.533801 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.534025 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.534115 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.534338 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.534420 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.534651 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.534740 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.534966 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.535064 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.535308 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.535391 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.535615 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.535779 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.535924 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.536015 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.536250 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.536333 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.536560 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.536653 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.536869 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.536954 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.537179 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.537269 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.537491 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.537586 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.537800 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.537884 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.538110 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.538236 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.538543 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.538629 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.538861 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.538943 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.539200 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.539298 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.539512 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.539597 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.539829 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.539912 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.540146 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.540228 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.540465 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.540595 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.540780 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.540864 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.541090 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.541205 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.541512 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.541597 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.541831 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.541915 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.542147 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.542236 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.542460 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.542552 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.542769 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.542852 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.543107 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.543210 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.543429 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.543521 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.543740 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.543823 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.544053 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.544146 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.544365 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.544448 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.544678 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.544769 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.544999 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.545094 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.545308 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.545391 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.545635 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.545758 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.546561 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.546660 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.546877 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.546962 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.547215 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.547331 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.547637 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.547724 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.547954 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.548036 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.548268 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.548352 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.548598 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.548689 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.548924 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.549013 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.549233 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.549316 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.549554 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.549638 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.549867 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.549949 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.550181 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.550262 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.550511 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.550595 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.550831 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.550952 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.551174 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.551270 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.551483 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.551567 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.551797 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.551880 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.552139 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.552245 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.552443 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.552534 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.552760 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.552843 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.553091 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.553184 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.553494 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.553591 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.553814 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.553900 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.554142 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.554226 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.554473 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.554568 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.554786 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.554870 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.555131 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.555218 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.555445 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.555531 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.555755 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.555883 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.556065 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.556148 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.556377 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.556470 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.556684 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.556767 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.557000 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.557086 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.557315 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.557406 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.557627 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.557709 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.557936 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.558020 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.558245 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.558330 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.558552 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.558637 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.558868 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.558958 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.559202 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.559288 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.559528 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.559611 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.559849 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.559941 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.560174 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.560257 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.560484 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.560585 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.560794 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.560889 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.561110 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.561193 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.561419 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.561502 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.562277 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.562377 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.562596 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.562680 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.562908 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.563020 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.563266 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.563361 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.563585 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.563668 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.563913 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.564005 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.564247 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.564332 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.564567 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.564658 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.564891 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.564982 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.565232 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.565327 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.565551 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.565635 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.565876 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.566006 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.566200 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.566286 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.566512 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.566602 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.566825 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.566922 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.567160 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.567246 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.567479 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.567574 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.567791 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.567889 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.568100 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.568185 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.568411 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.568496 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.568719 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.568816 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.569024 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.569115 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.569332 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.569415 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.569637 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.569728 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.569955 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.570039 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.570262 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.570352 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.570581 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.570667 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.570893 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.570993 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.571226 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.571310 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.571536 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.571633 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.571842 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.571926 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.572179 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.572262 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.572486 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.572572 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.572824 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.572907 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.573144 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.573227 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.573472 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.573559 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.573784 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.573867 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.574103 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.574187 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.574423 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.574507 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.574743 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.574827 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.575084 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.575184 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.575408 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.575493 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.575730 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.575813 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.576047 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.576144 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.576367 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.576459 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.576684 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.576775 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.576994 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.577120 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.577338 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.577423 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.577663 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.577748 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.577987 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.578189 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.578511 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.578596 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.578834 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.578919 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.579181 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.579277 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.579501 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.579585 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.579818 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.579902 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.580135 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.580220 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.580451 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.580543 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.580766 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.580850 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.581084 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.581168 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.581398 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.581483 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.581713 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.581804 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.582046 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.582137 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.582372 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.582455 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.582704 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.582798 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.583053 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.583142 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.583378 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.583463 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.583696 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.583793 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.584017 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.584103 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.584338 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.584423 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.584683 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.584771 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.585003 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.585110 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.585316 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.585408 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.585637 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.585721 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.585957 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.586042 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.586275 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.586370 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.586590 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.586674 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.586909 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.587006 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.587256 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.587354 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.587574 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.587666 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.587930 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.588022 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.588204 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.588290 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.588520 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.588604 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.588843 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.588976 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.589173 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.589266 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.589496 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.589588 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.589816 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.589902 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.590134 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.590219 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.590453 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.590538 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.590776 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.591024 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.591321 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.591452 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.591641 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.591731 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.591984 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.592077 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.592315 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.592407 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.592637 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.592721 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.592990 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.593091 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.593317 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.593409 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.593631 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.593714 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.593946 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.594039 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.594256 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.594347 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.594573 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.594656 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.594886 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.595001 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.595222 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.595305 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.595552 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.595637 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.595866 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.595952 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.596175 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.596304 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.596495 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.596579 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.596809 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.597030 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.597340 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.597424 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.597695 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.597781 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.598023 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.598109 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.598350 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.598433 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.598675 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.598773 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.599059 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.599161 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.599323 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.599407 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.599653 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.599746 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.599969 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.600053 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.600282 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.600366 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.600601 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.600696 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.600914 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.601000 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.601224 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.601306 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.601536 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.601630 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.601850 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.601935 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.602162 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.602246 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.602471 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.602555 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.602777 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.602860 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.603110 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.603198 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.603443 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.603528 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.603754 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.603839 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.604063 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.604160 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.604373 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.604464 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.604682 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.604765 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.604996 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.605079 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.605303 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.605388 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.605612 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.605696 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.605919 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.606173 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.606279 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.606415 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.606530 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.606616 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.606839 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.606934 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.607178 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.607263 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.607487 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.607570 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.607797 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.607898 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.608104 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.608189 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.608412 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.608991 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.609249 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.609342 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.609560 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.609656 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.609874 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.609960 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.610188 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.610284 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.610504 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.610587 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.610822 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.610907 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.611164 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.611301 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.611487 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.611608 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.611827 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.611910 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.612151 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.612408 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.612726 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.612820 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.613066 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.613159 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.613395 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.613481 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.613732 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.613817 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.614048 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.614207 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.614361 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.614447 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.614674 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.614766 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.614998 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.615102 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.615337 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.615430 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.615651 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.615735 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.615967 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.616060 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.616282 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.616366 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.616597 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.616684 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.616911 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.617013 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.617225 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.617310 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.617539 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.617631 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.617855 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.617940 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.618168 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.618259 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.618481 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.618564 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.618801 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.618886 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.619160 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.619248 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.619486 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.619569 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.619811 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.619898 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.620132 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.620216 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.620451 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.620544 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.620771 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.620857 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.621087 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.621171 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.621400 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.621561 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.621715 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.621804 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.622029 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.622114 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.622355 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.622456 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.622671 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.622756 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.623007 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.623096 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.623324 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.623410 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.623726 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.623809 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.624049 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.624160 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.624938 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.625033 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.625266 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.625350 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.625583 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.625667 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.625914 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.626001 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.626233 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.626318 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.626551 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.626644 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.626867 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.626951 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.627217 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.627302 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.627556 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.627654 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.627889 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.627980 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.628220 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.628306 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.628786 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.628888 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.629105 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.629190 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.629417 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.629512 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.629729 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.629823 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.630051 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.630137 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.630389 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.630474 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.630711 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.630798 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.631063 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.631174 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.631402 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.631513 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.631721 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.631808 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.632020 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.632130 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.632338 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.632423 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.632663 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.632749 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.632983 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.633070 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.633301 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.633401 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.633618 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.633703 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.633944 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.634028 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.634263 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.634355 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.634578 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.634663 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.634899 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.634999 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.635243 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.635342 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.635559 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.635643 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.635879 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.635964 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.636208 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.636294 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.636523 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.636610 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.636834 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.636918 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.637163 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.637248 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.637486 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.637569 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.637806 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.637889 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.638125 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.638212 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.638442 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.638525 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.638765 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.638911 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.639110 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.639197 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.639427 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.639558 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.639764 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.639858 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.640088 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.640181 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.640406 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.640490 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.640728 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.640822 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.641057 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.641142 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.641386 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.641479 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.641716 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.641816 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.642045 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.642137 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.642375 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.642460 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.642707 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.642793 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.643070 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.643170 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.643393 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.643480 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.643714 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.643808 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.644027 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.644114 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.644278 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 15:54:34.644363 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 15:54:34.644571 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 15:54:34.667230 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_db.sqlalchemy.engines [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:34.668235 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_db.sqlalchemy.engines [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:34.729533 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.context [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d846773d-1586-4f37-a106-5bfdc77828fd(cell1) {{(pid=101646) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 15:54:34.729846 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.context [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d846773d-1586-4f37-a106-5bfdc77828fd(cell1) {{(pid=101645) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 15:54:34.734295 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_concurrency.lockutils [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 15:54:34.734616 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 15:54:34.735903 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_concurrency.lockutils [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 15:54:34.736212 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 15:54:34.736710 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_concurrency.lockutils [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 15:54:34.737014 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 15:54:34.738652 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_concurrency.lockutils [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 15:54:34.738938 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 15:54:34.748721 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_db.sqlalchemy.engines [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:34.752224 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_db.sqlalchemy.engines [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:34.755350 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_db.sqlalchemy.engines [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:34.757756 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_db.sqlalchemy.engines [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:34.916068 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG oslo_db.sqlalchemy.engines [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:34.918793 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_db.sqlalchemy.engines [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 15:54:35.262693 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: WARNING keystonemiddleware.auth_token [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 15:54:35.263491 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: WARNING keystonemiddleware.auth_token [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 15:54:35.269664 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: WARNING keystonemiddleware.auth_token [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 15:54:35.270509 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: WARNING keystonemiddleware.auth_token [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 15:54:35.614937 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: WARNING keystonemiddleware.auth_token [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 15:54:35.615578 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: WARNING keystonemiddleware.auth_token [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 15:54:35.620141 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: WARNING keystonemiddleware.auth_token [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 15:54:35.620541 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: WARNING keystonemiddleware.auth_token [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 15:54:35.625967 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f46c679c0 pid: 101645 (default app) Jan 27 15:54:35.626288 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f46c679c0 pid: 101646 (default app) Jan 27 15:54:35.628081 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:54:35.629502 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-de519099-ac6e-4800-94cc-18fa9a7e2423 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001998 Jan 27 15:54:35.629915 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Thu Jan 27 15:54:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:00.908602 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:00.910363 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002517 Jan 27 15:56:00.910780 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:01.340560 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-40d1c9b5-9a28-4c6d-bfbe-24513e8bca23 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:01.369071 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-40d1c9b5-9a28-4c6d-bfbe-24513e8bca23 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451235 Jan 27 15:56:01.369540 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jan 27 15:56:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:03.645942 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:03.646931 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-b034dae4-321e-400a-9030-817fefe5ec80 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jan 27 15:56:03.647558 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 2/4] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:03.706040 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-0b57f357-2dfe-4b70-a785-f7278fcdfeb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:03.724724 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 15:56:03.724724 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: warnings.warn(msg) Jan 27 15:56:03.760493 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-0b57f357-2dfe-4b70-a785-f7278fcdfeb6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106515 Jan 27 15:56:03.761058 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 3/5] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:56:03.977874 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-7b1d134b-6bd0-4045-b6c8-d8f5dd70bad0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:03.980239 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 15:56:03.980239 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: warnings.warn(msg) Jan 27 15:56:04.026411 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-7b1d134b-6bd0-4045-b6c8-d8f5dd70bad0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257322 Jan 27 15:56:04.039528 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 3/6] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jan 27 15:56:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:06.314207 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-0b57f357-2dfe-4b70-a785-f7278fcdfeb6 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:06.315269 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-0b57f357-2dfe-4b70-a785-f7278fcdfeb6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jan 27 15:56:06.315719 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 4/7] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:06.419265 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-798f7ae8-69ec-48c8-b5e0-07cddbbf1b50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M"}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:06.436867 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 15:56:06.436867 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: warnings.warn(msg) Jan 27 15:56:06.456128 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-798f7ae8-69ec-48c8-b5e0-07cddbbf1b50 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134582 Jan 27 15:56:06.456891 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 4/8] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 15:56:06.468904 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-93628e19-1bf1-470e-b076-240e97e3c4af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:06.470375 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 15:56:06.470375 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: warnings.warn(msg) Jan 27 15:56:06.504251 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-93628e19-1bf1-470e-b076-240e97e3c4af admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038869 Jan 27 15:56:06.505174 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 5/9] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jan 27 15:56:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:08.806882 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-798f7ae8-69ec-48c8-b5e0-07cddbbf1b50 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:08.808196 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-798f7ae8-69ec-48c8-b5e0-07cddbbf1b50 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 Jan 27 15:56:08.808675 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:08.874739 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-0607f9a1-5e41-4573-8411-b7ff9a40de5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:08.893768 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-0607f9a1-5e41-4573-8411-b7ff9a40de5a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078043 Jan 27 15:56:08.901133 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 6/11] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 15:56:08.906389 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-da893cda-4c4c-45c9-8a69-6a6f28ad4191 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:08.931503 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-da893cda-4c4c-45c9-8a69-6a6f28ad4191 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028563 Jan 27 15:56:08.932190 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 6/12] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jan 27 15:56:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 15:56:11.214215 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-0607f9a1-5e41-4573-8411-b7ff9a40de5a admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:11.215443 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-0607f9a1-5e41-4573-8411-b7ff9a40de5a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Jan 27 15:56:11.216307 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 7/13] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:11.279417 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-44de7b16-e4af-4da6-abdb-084bc3c13235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "vcpus": 2}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:11.297563 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-44de7b16-e4af-4da6-abdb-084bc3c13235 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075225 Jan 27 15:56:11.298122 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 7/14] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 15:56:11.310353 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-2254f7a7-9083-47cb-827d-bad9cdd0f79d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:11.340047 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-2254f7a7-9083-47cb-827d-bad9cdd0f79d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033218 Jan 27 15:56:11.340977 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 8/15] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jan 27 15:56:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:13.620893 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-44de7b16-e4af-4da6-abdb-084bc3c13235 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:13.621910 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-44de7b16-e4af-4da6-abdb-084bc3c13235 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 27 15:56:13.622577 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 8/16] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:13.682194 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-4043e3a4-0f20-4d3b-986e-c75e7e1a39a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "vcpus": 4, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:13.702602 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-4043e3a4-0f20-4d3b-986e-c75e7e1a39a9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074035 Jan 27 15:56:13.706231 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 9/17] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:56:13.714814 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-14fec302-59c4-4627-94c3-db8c5c97dad3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:13.739219 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-14fec302-59c4-4627-94c3-db8c5c97dad3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027915 Jan 27 15:56:13.739842 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 9/18] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jan 27 15:56:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:16.020846 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-4043e3a4-0f20-4d3b-986e-c75e7e1a39a9 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:16.021827 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-4043e3a4-0f20-4d3b-986e-c75e7e1a39a9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jan 27 15:56:16.022485 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 10/19] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:16.088741 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-3aa881de-1583-4ba6-b0c6-b966889dea9c admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:16.113488 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-3aa881de-1583-4ba6-b0c6-b966889dea9c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084323 Jan 27 15:56:16.114048 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 10/20] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jan 27 15:56:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:56:18.630957 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-4043e3a4-0f20-4d3b-986e-c75e7e1a39a9 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:18.631987 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-4043e3a4-0f20-4d3b-986e-c75e7e1a39a9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 27 15:56:18.632430 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 11/21] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 15:56:18.692439 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-12631c96-e8c0-4e8d-b1bd-b76037f3640d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "disk": 1, "swap": 0}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:18.715807 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-12631c96-e8c0-4e8d-b1bd-b76037f3640d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077570 Jan 27 15:56:18.716586 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 11/22] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:56:18.731937 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-f2d80e1e-3d3b-4f5b-823b-6531b78f61a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:18.758830 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-f2d80e1e-3d3b-4f5b-823b-6531b78f61a9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030435 Jan 27 15:56:18.759668 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 12/23] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jan 27 15:56:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 15:56:21.352981 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-12631c96-e8c0-4e8d-b1bd-b76037f3640d admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:21.353989 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-12631c96-e8c0-4e8d-b1bd-b76037f3640d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jan 27 15:56:21.354388 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 12/24] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:21.417326 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-e0a0d252-d837-4c28-87d1-5ee809ba341d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:21.438452 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-e0a0d252-d837-4c28-87d1-5ee809ba341d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077708 Jan 27 15:56:21.439178 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 13/25] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:56:21.452624 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-732a82df-14a2-481f-903c-5a60f00b90c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:21.479805 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-732a82df-14a2-481f-903c-5a60f00b90c9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031675 Jan 27 15:56:21.480782 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 13/26] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jan 27 15:56:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:23.772327 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-e0a0d252-d837-4c28-87d1-5ee809ba341d admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:23.773999 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-e0a0d252-d837-4c28-87d1-5ee809ba341d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Jan 27 15:56:23.774435 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 14/27] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:23.831381 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-87d8a0d1-4b8c-4f41-83c6-bbfa0225de37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "disk": 40}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:23.849320 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-87d8a0d1-4b8c-4f41-83c6-bbfa0225de37 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069007 Jan 27 15:56:23.849883 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 14/28] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:56:23.861608 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-a27bc07c-e87a-4c51-9a31-1bb1729c971f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:23.886094 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-a27bc07c-e87a-4c51-9a31-1bb1729c971f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028039 Jan 27 15:56:23.886693 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 15/29] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jan 27 15:56:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 15:56:26.161358 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-87d8a0d1-4b8c-4f41-83c6-bbfa0225de37 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:26.162390 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-87d8a0d1-4b8c-4f41-83c6-bbfa0225de37 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 27 15:56:26.162836 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 15/30] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:26.230814 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-a1c3c8e9-9812-409d-90cf-3569f10c347e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "swap": 0, "disk": 80}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:26.250264 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-a1c3c8e9-9812-409d-90cf-3569f10c347e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081159 Jan 27 15:56:26.250822 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 16/31] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:56:26.265535 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-bb7cfe1d-b7c0-4b8b-948d-1058fe04d265 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:26.290042 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-bb7cfe1d-b7c0-4b8b-948d-1058fe04d265 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029899 Jan 27 15:56:26.290544 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 16/32] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jan 27 15:56:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:28.613632 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-a1c3c8e9-9812-409d-90cf-3569f10c347e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:28.614644 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-a1c3c8e9-9812-409d-90cf-3569f10c347e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jan 27 15:56:28.615154 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 17/33] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:28.676445 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-4564d165-b176-42be-81b2-2a17bfa09037 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:28.697581 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-4564d165-b176-42be-81b2-2a17bfa09037 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075332 Jan 27 15:56:28.698130 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 17/34] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jan 27 15:56:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 15:56:28.710281 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-876c9f7c-3c24-4a17-aaaa-ea8a59b28af1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:28.737400 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-876c9f7c-3c24-4a17-aaaa-ea8a59b28af1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031249 Jan 27 15:56:28.738259 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 18/35] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jan 27 15:56:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:56:51.343257 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-4564d165-b176-42be-81b2-2a17bfa09037 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:51.344280 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-4564d165-b176-42be-81b2-2a17bfa09037 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jan 27 15:56:51.344684 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 18/36] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:51.401667 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-6fe5704a-9a0c-40f9-8d47-308fd4273954 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:51.418167 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-6fe5704a-9a0c-40f9-8d47-308fd4273954 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066965 Jan 27 15:56:51.418737 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jan 27 15:56:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:56:52.800194 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-4564d165-b176-42be-81b2-2a17bfa09037 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:52.801245 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-4564d165-b176-42be-81b2-2a17bfa09037 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 27 15:56:52.801649 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 19/38] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:56:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:52.991443 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-687e0d39-6d6b-4af7-9407-a616b2f61f39 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:52.997205 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.wsgi [None req-687e0d39-6d6b-4af7-9407-a616b2f61f39 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 27 15:56:52.997780 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-687e0d39-6d6b-4af7-9407-a616b2f61f39 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 15:56:52.998586 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-687e0d39-6d6b-4af7-9407-a616b2f61f39 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057697 Jan 27 15:56:52.999121 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 20/39] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jan 27 15:56:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 15:56:53.008965 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-4b5d74da-38c4-4d87-8ab3-f2e3f68b22cb admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:53.029440 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-4b5d74da-38c4-4d87-8ab3-f2e3f68b22cb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023854 Jan 27 15:56:53.029907 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 20/40] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jan 27 15:56:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:56:53.039438 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-e89623f7-7d8c-47cf-9063-5b6c6aebe53d admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:53.059999 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-e89623f7-7d8c-47cf-9063-5b6c6aebe53d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024122 Jan 27 15:56:53.060558 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 21/41] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jan 27 15:56:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:56:53.070665 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-bd8b9212-7d7f-4da7-bdac-1dfad7df4a75 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:53.076131 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.wsgi [None req-bd8b9212-7d7f-4da7-bdac-1dfad7df4a75 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 27 15:56:53.076709 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-bd8b9212-7d7f-4da7-bdac-1dfad7df4a75 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 15:56:53.077797 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-bd8b9212-7d7f-4da7-bdac-1dfad7df4a75 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011201 Jan 27 15:56:53.078314 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 21/42] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jan 27 15:56:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 15:56:54.355329 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-e89623f7-7d8c-47cf-9063-5b6c6aebe53d admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:54.356339 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-e89623f7-7d8c-47cf-9063-5b6c6aebe53d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 27 15:56:54.356761 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 22/43] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:54.553059 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-d3a201af-4200-41b2-9848-cde847b3a8e2 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:54.558632 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.wsgi [None req-d3a201af-4200-41b2-9848-cde847b3a8e2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 27 15:56:54.559242 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-d3a201af-4200-41b2-9848-cde847b3a8e2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 15:56:54.560039 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-d3a201af-4200-41b2-9848-cde847b3a8e2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062121 Jan 27 15:56:54.560548 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jan 27 15:56:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 15:56:54.570299 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-e20db66c-952c-4199-a121-a0af371d0497 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:54.583929 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-e20db66c-952c-4199-a121-a0af371d0497 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017720 Jan 27 15:56:54.584444 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 23/45] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jan 27 15:56:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:56:54.593545 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-8aab3d18-4aed-4804-b7ca-11053416e6d0 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:54.606875 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-8aab3d18-4aed-4804-b7ca-11053416e6d0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016693 Jan 27 15:56:54.607464 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jan 27 15:56:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 15:56:54.616857 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-f21cf6b8-5e69-4280-ab09-865cb33d333f admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:54.622280 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.wsgi [None req-f21cf6b8-5e69-4280-ab09-865cb33d333f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 27 15:56:54.622834 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-f21cf6b8-5e69-4280-ab09-865cb33d333f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 15:56:54.623632 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-f21cf6b8-5e69-4280-ab09-865cb33d333f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010501 Jan 27 15:56:54.624150 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 24/47] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jan 27 15:56:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 15:56:55.891705 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-8aab3d18-4aed-4804-b7ca-11053416e6d0 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:55.892774 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-8aab3d18-4aed-4804-b7ca-11053416e6d0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jan 27 15:56:55.893177 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 24/48] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:56:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:56.088341 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-3767e624-819b-4ba7-8bf3-e9e93d2e4ce6 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:56.093456 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.wsgi [None req-3767e624-819b-4ba7-8bf3-e9e93d2e4ce6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 27 15:56:56.094019 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-3767e624-819b-4ba7-8bf3-e9e93d2e4ce6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 15:56:56.094807 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-3767e624-819b-4ba7-8bf3-e9e93d2e4ce6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058794 Jan 27 15:56:56.095354 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 25/49] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jan 27 15:56:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 15:56:56.105258 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-0f523198-055a-49bc-8e1e-fd6402eacfda admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:56.119205 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-0f523198-055a-49bc-8e1e-fd6402eacfda admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017562 Jan 27 15:56:56.120001 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 25/50] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jan 27 15:56:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:56:56.129832 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:56.142651 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016743 Jan 27 15:56:56.143212 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 26/51] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jan 27 15:56:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:56:56.152096 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-074547b1-0b39-404f-b05a-09881e97d1af admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:56.157694 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.wsgi [None req-074547b1-0b39-404f-b05a-09881e97d1af admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 27 15:56:56.158264 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-074547b1-0b39-404f-b05a-09881e97d1af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 15:56:56.159097 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-074547b1-0b39-404f-b05a-09881e97d1af admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010460 Jan 27 15:56:56.159602 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 26/52] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jan 27 15:56:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 27 15:56:57.429047 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:57.430079 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 27 15:56:57.430479 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 27/53] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:56:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 15:56:57.634352 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-48a023b3-1be9-424b-a7e4-171f86739269 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:57.652948 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-48a023b3-1be9-424b-a7e4-171f86739269 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081940 Jan 27 15:56:57.653511 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 27/54] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jan 27 15:56:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:56:58.939453 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:56:58.940441 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 27 15:56:58.941334 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 28/55] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:56:59.132535 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-d5fb08a7-c509-4633-be7c-2e24f073af0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:56:59.149970 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-d5fb08a7-c509-4633-be7c-2e24f073af0a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068787 Jan 27 15:56:59.150455 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 28/56] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jan 27 15:56:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:57:00.554941 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:00.556019 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jan 27 15:57:00.556439 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 29/57] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:57:00.749509 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-86ffe9cc-9989-42bc-9b52-046e52e0f9ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:57:00.768071 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-86ffe9cc-9989-42bc-9b52-046e52e0f9ac admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070950 Jan 27 15:57:00.768623 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 29/58] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jan 27 15:57:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:57:02.050157 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:02.051181 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jan 27 15:57:02.051579 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 30/59] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 15:57:02.246404 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-a2bfb2ee-549e-49c7-9b6a-d4b38ba389e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 15:57:02.264051 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-a2bfb2ee-549e-49c7-9b6a-d4b38ba389e8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070023 Jan 27 15:57:02.264546 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 30/60] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jan 27 15:57:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 15:57:03.565541 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:03.566539 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 27 15:57:03.566937 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 31/61] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 15:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:57:03.764797 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-35d521bc-ef08-49e1-a2f4-c9ab7de6c31c admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:03.786341 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-35d521bc-ef08-49e1-a2f4-c9ab7de6c31c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080274 Jan 27 15:57:03.786895 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 31/62] 10.222.0.61 () {60 vars in 1202 bytes} [Thu Jan 27 15:57:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 15:57:49.968725 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:49.969729 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-329c1fd4-2b3c-4644-93c4-65724c0af08e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 27 15:57:49.970126 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 32/63] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jan 27 15:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 15:57:50.030821 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-1d069d83-a362-44fb-a851-a0dadac2cc29 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:50.052454 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-1d069d83-a362-44fb-a851-a0dadac2cc29 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076442 Jan 27 15:57:50.052986 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 32/64] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jan 27 15:57:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 15:57:50.080430 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-32ff9d32-0869-4587-8c83-b038eee999aa admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:50.088169 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-32ff9d32-0869-4587-8c83-b038eee999aa admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011327 Jan 27 15:57:50.088685 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 33/65] 10.222.0.61 () {60 vars in 1282 bytes} [Thu Jan 27 15:57:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:57:50.100242 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-ea604ce0-769a-49f2-b769-11dab1f08ace admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:50.108676 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-ea604ce0-769a-49f2-b769-11dab1f08ace admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012408 Jan 27 15:57:50.109285 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 33/66] 10.222.0.61 () {60 vars in 1285 bytes} [Thu Jan 27 15:57:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 15:57:50.120633 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-dcbe0502-70bd-48be-9e02-6458b2aaa8b7 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:50.128508 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-dcbe0502-70bd-48be-9e02-6458b2aaa8b7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011383 Jan 27 15:57:50.129078 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 34/67] 10.222.0.61 () {60 vars in 1285 bytes} [Thu Jan 27 15:57:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:57:50.140836 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:57:50.148692 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011485 Jan 27 15:57:50.149238 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 34/68] 10.222.0.61 () {60 vars in 1282 bytes} [Thu Jan 27 15:57:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 15:59:19.316170 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-a9541f89-7916-4484-9992-72250eab5299 tempest-verify_tempest_config-2017601424 tempest-verify_tempest_config-2017601424-project] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 15:59:19.318195 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-a9541f89-7916-4484-9992-72250eab5299 tempest-verify_tempest_config-2017601424 tempest-verify_tempest_config-2017601424-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106564 Jan 27 15:59:19.318733 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 35/69] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Jan 27 15:59:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:00:50.211472 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:00:50.213247 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jan 27 16:00:50.213651 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 35/70] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 16:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:00:50.467722 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-fa55598f-6f8c-469a-9b90-605305a86eed admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:00:50.468897 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:00:50.468897 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: warnings.warn(msg) Jan 27 16:00:50.470425 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fa55598f-6f8c-469a-9b90-605305a86eed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:00:50.470872 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fa55598f-6f8c-469a-9b90-605305a86eed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:00:50.471789 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fa55598f-6f8c-469a-9b90-605305a86eed admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:00:50.472219 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fa55598f-6f8c-469a-9b90-605305a86eed admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:00:50.506139 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-fa55598f-6f8c-469a-9b90-605305a86eed admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150464 Jan 27 16:00:50.506693 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 36/71] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jan 27 16:00:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:00:51.819114 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:00:51.820120 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jan 27 16:00:51.820519 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 36/72] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 16:00:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:00:52.016544 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-fb9be7c8-a13c-4e5e-87b2-2d7ba6795268 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:00:52.017710 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:00:52.017710 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: warnings.warn(msg) Jan 27 16:00:52.019253 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fb9be7c8-a13c-4e5e-87b2-2d7ba6795268 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:00:52.019696 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fb9be7c8-a13c-4e5e-87b2-2d7ba6795268 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:00:52.020495 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fb9be7c8-a13c-4e5e-87b2-2d7ba6795268 admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:00:52.020923 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-fb9be7c8-a13c-4e5e-87b2-2d7ba6795268 admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:00:52.040005 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-fb9be7c8-a13c-4e5e-87b2-2d7ba6795268 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074360 Jan 27 16:00:52.040508 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 37/73] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jan 27 16:00:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:01:03.750096 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:01:03.751168 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 27 16:01:03.751812 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 37/74] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 16:01:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:01:03.953236 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-8e702629-61f9-4f80-b14e-c58cb6869b12 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:01:03.954403 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:01:03.954403 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: warnings.warn(msg) Jan 27 16:01:03.956038 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-8e702629-61f9-4f80-b14e-c58cb6869b12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:01:03.956427 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-8e702629-61f9-4f80-b14e-c58cb6869b12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:01:03.957220 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-8e702629-61f9-4f80-b14e-c58cb6869b12 admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:01:03.957646 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-8e702629-61f9-4f80-b14e-c58cb6869b12 admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:01:03.981392 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-8e702629-61f9-4f80-b14e-c58cb6869b12 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080097 Jan 27 16:01:03.981941 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 38/75] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jan 27 16:01:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:01:05.252858 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: DEBUG nova.api.openstack.wsgi [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] Calling method '>' {{(pid=101646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:01:05.253858 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: INFO nova.api.openstack.requestlog [None req-f75d8efa-0df4-4961-82be-82460ba54be7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 27 16:01:05.254258 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: [pid: 101646|app: 0|req: 38/76] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jan 27 16:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:01:05.447083 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG nova.api.openstack.wsgi [None req-5f320b8b-1ff3-431e-ab05-bc6b7c888b53 admin admin] Calling method '>' {{(pid=101645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:01:05.448337 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:01:05.448337 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: warnings.warn(msg) Jan 27 16:01:05.449874 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-5f320b8b-1ff3-431e-ab05-bc6b7c888b53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:01:05.450311 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-5f320b8b-1ff3-431e-ab05-bc6b7c888b53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:01:05.451698 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-5f320b8b-1ff3-431e-ab05-bc6b7c888b53 admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:01:05.452179 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: DEBUG oslo_concurrency.lockutils [None req-5f320b8b-1ff3-431e-ab05-bc6b7c888b53 admin admin] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:01:05.472998 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: INFO nova.api.openstack.requestlog [None req-5f320b8b-1ff3-431e-ab05-bc6b7c888b53 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076686 Jan 27 16:01:05.473560 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: [pid: 101645|app: 0|req: 39/77] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jan 27 16:01:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:02:04.955113 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: Thu Jan 27 16:02:04 2022 - graceful shutdown triggered... Jan 27 16:02:04.955214 dv-cinder-826350-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 27 16:02:04.956243 dv-cinder-826350-3-iscsi devstack@n-api.service[101646]: Gracefully killing worker 2 (pid: 101646)... Jan 27 16:02:04.956633 dv-cinder-826350-3-iscsi devstack@n-api.service[101645]: Gracefully killing worker 1 (pid: 101645)... Jan 27 16:02:05.957346 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: worker 1 buried after 1 seconds Jan 27 16:02:05.957346 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: worker 2 buried after 1 seconds Jan 27 16:02:05.958036 dv-cinder-826350-3-iscsi devstack@n-api.service[101644]: goodbye to uWSGI. Jan 27 16:02:05.958944 dv-cinder-826350-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 27 16:02:05.959525 dv-cinder-826350-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 27 16:02:05.962311 dv-cinder-826350-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 27 16:02:05.971740 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jan 27 16:02:05 2022] *** Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: nodename: dv-cinder-826350-3-iscsi Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: machine: x86_64 Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: clock source: unix Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: pcre jit disabled Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: detected number of CPU cores: 4 Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: current working directory: / Jan 27 16:02:05.973623 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: detected binary path: /usr/bin/uwsgi-core Jan 27 16:02:05.974332 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: your processes number limit is 47680 Jan 27 16:02:05.974332 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: your memory page size is 4096 bytes Jan 27 16:02:05.974332 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: detected max file descriptor number: 2048 Jan 27 16:02:05.974332 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: lock engine: pthread robust mutexes Jan 27 16:02:05.974332 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: thunder lock: enabled Jan 27 16:02:05.974332 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 27 16:02:05.974332 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 27 16:02:06.020290 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: Python main interpreter initialized at 0x562a7126c9c0 Jan 27 16:02:06.020290 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: python threads support enabled Jan 27 16:02:06.020290 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: your server socket listen backlog is limited to 100 connections Jan 27 16:02:06.020290 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: your mercy for graceful operations on workers is 90 seconds Jan 27 16:02:06.020732 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: mapped 403077 bytes (393 KB) for 2 cores Jan 27 16:02:06.020732 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: *** Operational MODE: preforking *** Jan 27 16:02:06.021026 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: *** uWSGI is running in multiple interpreter mode *** Jan 27 16:02:06.021026 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: spawned uWSGI master process (pid: 116243) Jan 27 16:02:06.021237 dv-cinder-826350-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 27 16:02:06.021954 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: spawned uWSGI worker 1 (pid: 116260, cores: 1) Jan 27 16:02:06.023437 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: spawned uWSGI worker 2 (pid: 116261, cores: 1) Jan 27 16:02:06.023437 dv-cinder-826350-3-iscsi devstack@n-api.service[116243]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 27 16:02:08.009319 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:02:08.009319 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: from cryptography.utils import int_from_bytes Jan 27 16:02:08.010032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:02:08.010032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: from cryptography.utils import int_from_bytes Jan 27 16:02:08.011663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:02:08.011663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: from cryptography.utils import int_from_bytes Jan 27 16:02:08.012148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:02:08.012148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: from cryptography.utils import int_from_bytes Jan 27 16:02:10.458967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:02:10.459950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:02:10.460643 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:02:10.461017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:02:10.461821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:02:10.462222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.462810 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.462940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.463315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.463657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.464030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.464323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.464637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.464977 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.465246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.465569 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.465903 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-3-iscsi {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.466233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.466548 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.466826 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:02:10.467311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.467395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:02:10.467473 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.467550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.467630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:02:10.467831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.467997 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:02:10.468151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.468250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:02:10.468606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.470042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.470276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.470488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.470696 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.470914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.471161 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.471406 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.471629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.471835 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.472054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.472295 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.472503 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.472726 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.472931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.473139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.473344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.473563 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.473768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.473988 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.474204 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.474420 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.474637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-3-iscsi {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.474637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.475105 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-3-iscsi {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.475348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.475533 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.475752 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.475952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.476107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.476252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.476428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.476574 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.476766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.477493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.477493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.477780 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.477941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.477941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.478230 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.478398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.478550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.478705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.478884 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.479064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.479215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.479368 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.479512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.480710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.480882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.481044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.481198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.481389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.481612 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.481761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.481918 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.482146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.482311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.482457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.482600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.482764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.482764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.483123 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-3-iscsi {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.483283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.483428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.483571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.483713 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.483870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.484024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.484169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.484323 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.484468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.484636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.484781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.484926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.485069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.485219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.485374 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.485536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.485691 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.485835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.485978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.486122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.486263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.486424 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.486570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.486712 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.486862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.487033 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.487298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.487447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.487590 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.487742 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.487887 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.488030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.488182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.488326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.488506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.489227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.489396 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.489552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.489707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.490466 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.490774 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.491035 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.491202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.491358 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.491518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.491670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.491824 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.491981 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.492136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.492320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.492534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.492688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.492836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.492979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.493130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.493293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.493440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.493583 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.493583 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.493881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.494044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.494189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.494342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.494487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.494637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.494781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.494933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.495113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.495259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.495409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.498652 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.498857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.498857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.499227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.499846 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.500612 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.500956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.501506 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.501675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.501833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.501988 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.502141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.502303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.502461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.502617 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.502772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.502928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.503157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.503311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.503470 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.503624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.503776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.503929 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.504084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.504245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.504389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.504539 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.504698 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.504850 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.505003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.505160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.505304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.505455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.505606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.505749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.505892 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.506046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.506197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.506341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.506507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.506652 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.506795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.506952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.507159 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.507305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.507461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.507621 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.507766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.507917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.508071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.508229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.508382 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.508382 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.508673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.508818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.508969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.509127 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.509279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.509430 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.509580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.509732 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.509916 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.510079 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.510490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.510827 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.511185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.511348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.511520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.511800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.511958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.512114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.512267 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.512426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.512571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.512724 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.512877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.513029 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.513181 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.513346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.513571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.513726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.513879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.514031 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.514182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.514340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.514500 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.514646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.514796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.514954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.515154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.515298 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.515453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.515608 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.515753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.515910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.516055 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.516207 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.516362 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.516507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.516659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.516817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.516970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.517114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.517276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.517435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.517590 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.517734 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.517884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.518028 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.518171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.518314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.518471 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.518626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.518771 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.518914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.519160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.519333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.519478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.519622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.519622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.520912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.521098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.521428 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.521581 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.521727 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.521994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.522154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.522317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.522473 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.522630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.522789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.522934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.523102 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.523263 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.523419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.523570 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.524213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.524357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.524500 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.524657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:02:10.524803 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.524965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.525119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.525263 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.525416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.525575 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.525727 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.525880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.526025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.526167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.526312 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.526468 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.526622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.526776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.526939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.527109 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.527254 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.527407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.527565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.527718 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.527871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.528097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.528243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.528400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.528545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.528695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.528846 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.529012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.529159 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.529311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.529455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.529597 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.529740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.529891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.530043 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.530197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.530349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.530519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.531173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.531359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.531670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.531826 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.531990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.532232 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.532383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.532527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.532683 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.532835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.532992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.533136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.533281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.533438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.533603 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.533757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.533902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.534052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.534209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.534361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.534514 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.534665 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.534817 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.534961 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.535130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.535278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.535434 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.535600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.535745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.535896 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.536041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.536192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.536336 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.536488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.536632 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.536781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.536925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.537075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.537228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.537388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.537542 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.537693 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.537845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.538066 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.538220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.538373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.538518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.538660 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.538811 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.538968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.539139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.539283 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.540039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.540185 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.540345 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.540498 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.540643 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.541218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.541384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.541554 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.541874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.542041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.542281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.542516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.542674 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.542830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.543002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.543164 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.543310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.543460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.543705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.543864 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.544018 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.544162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.544318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.544463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.544607 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.544773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.544943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.545095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.545244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.545401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.545559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.545718 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.545871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.546021 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.546170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.546327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.546485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.546648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.546815 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.546967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.547176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.547336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.547488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.547646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.547804 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.547963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.548121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.548281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.548441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.548591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.548747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.548907 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.549058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.549206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.549369 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.549521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.549679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.549831 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.549987 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.550139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.550303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.550473 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.551462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.551629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.551982 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.552295 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.552477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.552639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.552639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.553060 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.553213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.553455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.553626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.553779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.553928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.554087 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.554246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.554424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.554576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.554734 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.554910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.555118 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.555282 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.555448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.555606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.555764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.555914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.556062 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.556211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.556370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.556540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.556700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.556850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.557007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.557156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.557315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.557466 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.557616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.557764 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.557921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.558081 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.558239 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.558408 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.558560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.558708 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.558857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.559043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.559210 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.559361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.559511 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.559661 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.559884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.560061 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.560222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.560373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.560534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.560683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.560832 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.560991 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.561148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.561590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.561754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.561906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.562242 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.562407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.562566 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.562727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.562897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.563162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.563339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.563493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.563653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.563804 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.563963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.564115 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.564274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.564433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.564592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.564744 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.569400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.569599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.569799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.569963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.570120 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.570283 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.570437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.570631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.570631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.570631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.571114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.571277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.571449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.571653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.571811 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.571974 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.572153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.572327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.572487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.572648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.572648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.572936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.573088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.575079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.575259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.575259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.575575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.575747 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.575901 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.576060 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.576213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.576375 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.576375 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.576672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.576824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.576973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.577209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.577372 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.577524 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.577675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.577844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.578005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.578170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.578330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.578488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.579459 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.579627 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.579790 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.579953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.580106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.580264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.580426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.580576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.580747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.580912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.582258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.582438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.582604 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.582757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.582918 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.583136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.583299 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.583451 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.583603 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.583753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.583912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.584075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.584578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.584748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.584910 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.585408 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.585622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.585789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.585789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.586658 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.586826 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.587043 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.587183 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.587310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.587454 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.587593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.587756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.587902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.588032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.588167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.588430 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.588564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.588716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.589228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.589366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.589527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.589647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.589759 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.589869 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.589994 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.590114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.590225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.590344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.590344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.590644 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.590783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.590914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.591069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.591200 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.591328 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.591469 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.591633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.591764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.591901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.592022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.592138 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.592274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.592404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.592404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.592625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.593946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.594090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.594237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.594368 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.594496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.594623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.594753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.594956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.595125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.595257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.595588 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.595768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.595908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596665 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596665 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.596915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.597043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.597170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.597299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.597436 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.597580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.597710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.597868 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598006 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598656 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.598968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.599484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.599630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.599761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.599897 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.600134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.600267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.600412 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.600550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.600681 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.600815 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.600958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.601116 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.601247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.601384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.601520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.601657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.601846 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.602513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.602643 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.602775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.602904 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.603130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.603263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.603971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.604115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.604246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.604246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.604530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.604530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.604792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.604792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.605050 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.605172 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.605297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.605433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.605768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.605983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.606115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.606252 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.606392 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.606559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.606700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.606830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.606958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.607127 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.607259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.607394 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.607531 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.607669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.607798 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608523 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608815 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.608953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.609082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.609610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.609749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.609879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.610016 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.610153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.610282 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.610418 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.610547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.610547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.610842 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.611080 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.611214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.611344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.611479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.611616 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.611753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.611891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.612547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613037 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613539 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.613941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614207 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614719 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.614879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.615309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.615519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.615519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.615519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.616105 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.616264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.616264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.616766 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.616898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.616898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.617164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.617324 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.617324 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.617614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.617902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.617902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618264 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618544 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.618933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619841 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.619935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620271 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.620906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621062 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621780 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.621780 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.622879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623159 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.623959 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624050 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624451 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624451 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624621 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624802 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.624885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625793 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625890 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.625890 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626682 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626682 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626842 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.626931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627483 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627814 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.627910 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628241 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628422 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628833 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.628928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629483 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.629906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630338 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630589 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630832 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.630914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.631992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.632820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633375 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633375 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633621 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633621 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633863 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.633863 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634028 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634284 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634932 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.634932 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635165 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635407 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.635973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.636069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.636069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.636290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.636382 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.636657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.636746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.637006 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.637246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.637353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.637589 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.637733 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.638014 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.638220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.638364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.638660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.638800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.639019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.639169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.639336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.639580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.639719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.639997 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.640135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.640280 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.640483 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.640622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.640918 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.641068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.641230 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.641408 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.641670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.641837 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.641987 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.642290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.642430 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.642603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.642854 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.643024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.643250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.643355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.643561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.643792 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.643884 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.644160 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.644261 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.644486 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.644680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.644795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.645112 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.645217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.645427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.645620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.645720 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.646030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.646131 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.646337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.646501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.646687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.646927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.647103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.647401 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.647547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.647761 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.647899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.648200 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.648345 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.648443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.649312 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.649421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.649647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.649817 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.649991 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.650247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.650367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.650602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.650840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.650939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.651259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.651363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.651579 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.651765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.651898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.652211 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.652317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.652528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.652707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.652848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.653175 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.653289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.653577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.653717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.654015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.654115 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.654347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.654488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.654664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.654935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.655062 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.655313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.655437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.655632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.655891 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.655999 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.656252 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.656343 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.656567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.656779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.656869 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.657206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.657308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.657534 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.657671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.657861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.658125 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.658222 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.658501 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.658601 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.658818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.659158 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.659362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.659474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.659651 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.659821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.660123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.660225 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.660443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.660549 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.660750 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.660844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.661068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.661170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.661386 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.661493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.661700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.661871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.662014 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.662166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.662312 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.662470 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.662614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.662756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.662907 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.663107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.663400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.663542 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.663684 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.663846 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.664003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.664156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.664156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.664966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.665057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.665139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.665361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.665464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.665673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.665764 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.665987 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.666085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.666307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.666596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.666830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.666922 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.667180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.667339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.667520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.667767 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.667920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.668080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.668229 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.668383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.668534 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.668681 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.668836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.668984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.669133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.669296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.669447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.669586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.669728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.669874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.670021 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.670171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.670417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.670553 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.670695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.670835 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.671004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.671154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.671317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.671465 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.671606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.671754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.671909 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.672050 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.672189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.672329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.672588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.672729 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.672882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.673023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.673259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.673554 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.673650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.673743 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.673880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.673982 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.674189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.674288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.674499 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.674590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.674813 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.674907 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.675145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.675239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.675451 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.675559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.675757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.675867 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.676082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.676184 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.676388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.676489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.676697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.676795 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.677015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.677105 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.677322 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.677427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.677628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.677720 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.677933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.678026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.678239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.678331 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.678571 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.678671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.678881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.678973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.679218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.679320 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.679530 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.679631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.679870 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.679981 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.680179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.680272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.680491 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.680595 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.680797 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.680897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.681106 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.681206 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.681420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.681512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.681728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.681828 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.682043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.682141 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.682351 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.682454 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.682667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.682834 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.682994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.683090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.683311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.683402 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.683630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.683757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.683936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.684076 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.684243 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.684526 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.684620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.684855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.684954 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.685169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.685274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.685482 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.685587 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.685798 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.685890 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.686111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.686200 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.686426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.686524 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.686742 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.686842 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.687078 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.687373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.687505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.687715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.687910 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.688041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.688249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.688381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.688575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.688719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.688906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.689032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.689244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.689344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.689563 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.689664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.689880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.689981 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.690197 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.690296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.690534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.690672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.690866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.690994 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.691209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.691313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.691520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.691615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.691836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.691936 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.692165 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.692279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.692480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.692572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.692793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.692884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.693105 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.693205 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.693419 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.693519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.693749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.693860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.694072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.694168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.694385 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.694484 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.694701 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.694802 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.695043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.695162 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.695368 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.695499 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.695710 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.695816 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.696026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.696130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.696339 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.696443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.696651 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.696773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.696978 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.697082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.697312 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.697496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.697632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.697813 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.697939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.698148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.698364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.698460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.698682 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.698793 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.699034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.699143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.699363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.699455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.699677 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.699778 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.700003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.700096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.700318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.700416 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.700635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.700759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.700947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.701051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.701255 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.701358 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.701597 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.701794 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.701875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.701946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.702255 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.702423 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.702549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.702735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.702864 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.703158 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.703254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.703500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.703865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.704036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.704185 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.704332 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.704476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.704625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.704794 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.704950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.705093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.705238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.705386 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.705540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.705682 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.705829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.706004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.706163 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.706333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.706490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.706659 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.706809 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.707003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.707164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.707314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.707484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.707643 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.707784 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.707937 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.708097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.708254 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.708406 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.708545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.708683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.708845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.708995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.709162 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.709306 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.709449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.709589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.709768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.709927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.710080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.710178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.710375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.710476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.710684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.710843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.711051 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.711662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.711889 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.711989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.712211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.712317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.712524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.712621 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.712833 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.712924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.713153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.713259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.713460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.713552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.713771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.714023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.714178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.714278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.714424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.714520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.714667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.714769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.715008 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.715106 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.715302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.715407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.715627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.715720 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.715934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.716026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.716238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.716328 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.716552 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.716652 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.716866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.717017 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.717192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.717337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.717506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.717608 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.717819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.717911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.718167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.718311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.718471 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:02:10.718619 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.719082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.719426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.719751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.720090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.720426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.720738 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.721048 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.721360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.721689 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.722005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.722342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.722656 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.722969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.723325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.723631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.723944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.724258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.724572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.724884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.725195 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.725513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.725858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.726182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.726504 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.727770 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.728097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.728415 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.728729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.729041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.729353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.729672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.730004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.730320 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.730628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.731071 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.731391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.731715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.732040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.732351 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.732676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.733002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.733316 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.733642 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.733961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.734297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.734640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.734971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.735316 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.735626 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.735935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.736262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.736576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.737156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.737272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.737546 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.737976 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.738184 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.738511 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.738825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.739183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.739527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.739831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.740146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.740478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.740788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.741098 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.741420 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.741736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.742044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.742379 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_db.sqlalchemy.engines [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:10.742489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.742713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.743065 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.743373 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.743699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.744023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.744391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.744660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.744969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.745297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.745610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.745924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.746239 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.746556 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.746871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.747213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.747540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.747865 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.748191 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.748519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.748869 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.749186 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.749666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.749859 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.750180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.750489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.750798 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:02:10.751063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:02:10.775603 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_db.sqlalchemy.engines [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:10.806363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.context [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d846773d-1586-4f37-a106-5bfdc77828fd(cell1) {{(pid=116261) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 16:02:10.810685 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:10.812282 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:10.813097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:10.815074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:10.825732 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_db.sqlalchemy.engines [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:10.832250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_db.sqlalchemy.engines [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:10.839783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.context [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d846773d-1586-4f37-a106-5bfdc77828fd(cell1) {{(pid=116260) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 16:02:10.844108 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:10.845661 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:10.846472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:10.848407 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:10.858948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_db.sqlalchemy.engines [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:10.860265 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_db.sqlalchemy.engines [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:10.987578 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_db.sqlalchemy.engines [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:11.021212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_db.sqlalchemy.engines [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:02:11.312699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: WARNING keystonemiddleware.auth_token [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:02:11.319463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: WARNING keystonemiddleware.auth_token [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:02:11.354033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: WARNING keystonemiddleware.auth_token [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:02:11.361420 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: WARNING keystonemiddleware.auth_token [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:02:11.663532 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: WARNING keystonemiddleware.auth_token [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:02:11.669292 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: WARNING keystonemiddleware.auth_token [None req-8b4022a4-052e-4966-b8f1-6c7aa519df57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:02:11.674657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a7126c9c0 pid: 116261 (default app) Jan 27 16:02:11.711888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: WARNING keystonemiddleware.auth_token [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:02:11.717437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: WARNING keystonemiddleware.auth_token [None req-17641d70-e174-4d59-ac8c-51619d294a0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:02:11.722671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a7126c9c0 pid: 116260 (default app) Jan 27 16:02:46.450812 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-287f1768-c4d9-47a3-bae6-e07af0b9480c tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Action: 'create', calling method: .version_select at 0x7f781481ac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1985343803", "metadata": {"Type": "work"}}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:02:46.896591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7190f54b-01d8-4cf8-8f89-7b23601b0ec3 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Action: 'create', calling method: .version_select at 0x7f7814818ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1024066897"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:02:47.858934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-287f1768-c4d9-47a3-bae6-e07af0b9480c tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.633831 Jan 27 16:02:47.862058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jan 27 16:02:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2638 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 27 16:02:47.954173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1602109471", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "2d24f765-3ff4-4cb1-af32-f521711e7f0b"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:02:48.162916 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] validate_networks() for [('2d24f765-3ff4-4cb1-af32-f521711e7f0b', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:02:48.397432 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7190f54b-01d8-4cf8-8f89-7b23601b0ec3 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.809714 Jan 27 16:02:48.399002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 1/2] 10.222.0.61 () {60 vars in 1154 bytes} [Thu Jan 27 16:02:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2815 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 27 16:02:48.404079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6f08f5fa-c18f-4461-8877-c890b6842562 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Calling method '.version_select at 0x7f78146e5820>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:48.481335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6f08f5fa-c18f-4461-8877-c890b6842562 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084" status: 200 len: 353 microversion: 2.1 time: 0.080816 Jan 27 16:02:48.482365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:48 2022] GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:48.487437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-aae80c4e-0bcc-4195-a742-c4148b2d24bb tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f78146e5ee0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:48.563493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-aae80c4e-0bcc-4195-a742-c4148b2d24bb tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 200 len: 345 microversion: 2.1 time: 0.079555 Jan 27 16:02:48.565169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:48 2022] GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:49.234268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:02:49.241353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:02:49.243202 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:02:49.243883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:02:49.245243 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:02:49.276449 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:49.277367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:49.278520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:49.279286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:49.329888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Getting quotas for project 552a2b3a672744b885fb48a990f14fa8. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:02:49.347821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Getting quotas for user 127cb7e8d04b4b5a8a5efa2c50383df0 and project 552a2b3a672744b885fb48a990f14fa8. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:02:49.373858 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:02:49.380369 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:02:49.478638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-28e8a7c6-3b66-4593-a7c6-c1fef4b76063 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.613903 Jan 27 16:02:49.479678 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 2/5] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:02:49.490970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2719686d-d83d-4334-b82b-400bdb070168 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:49.492108 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2719686d-d83d-4334-b82b-400bdb070168 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:49.511443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9870be99-633f-4e19-8151-6b3f848bc7f8 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Calling method '.version_select at 0x7f7813d7d4c0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:49.621394 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9870be99-633f-4e19-8151-6b3f848bc7f8 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084" status: 200 len: 354 microversion: 2.1 time: 0.121506 Jan 27 16:02:49.621965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 3/6] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:49 2022] GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:49.626741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6bc6293d-f055-45d4-953a-889c0610ca60 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7813d950d0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:49.672954 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2719686d-d83d-4334-b82b-400bdb070168 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:49.700208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2719686d-d83d-4334-b82b-400bdb070168 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1215 microversion: 2.1 time: 0.214464 Jan 27 16:02:49.700791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:49 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:49.719280 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6bc6293d-f055-45d4-953a-889c0610ca60 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 200 len: 345 microversion: 2.1 time: 0.095763 Jan 27 16:02:49.720302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:49 2022] GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:49.721862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e0767ec4-e11f-4cad-a8f1-7fe00adf2dcf tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Calling method '.version_select at 0x7f78146e5940>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:49.820442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e0767ec4-e11f-4cad-a8f1-7fe00adf2dcf tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084" status: 200 len: 354 microversion: 2.1 time: 0.108833 Jan 27 16:02:49.821000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 5/9] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:49 2022] GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:49.858837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c1187a2d-c514-4ab3-949b-97e1fa4eb40f tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Calling method '.version_select at 0x7f7813d7dee0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:49.984217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c1187a2d-c514-4ab3-949b-97e1fa4eb40f tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084" status: 202 len: 0 microversion: 2.1 time: 0.128965 Jan 27 16:02:49.984980 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 5/10] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jan 27 16:02:49 2022] DELETE /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:02:49.992775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e882af7f-9828-47d4-b761-82c09cbeda5c tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Calling method '.version_select at 0x7f7814640790>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:50.064172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e882af7f-9828-47d4-b761-82c09cbeda5c tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084" status: 200 len: 353 microversion: 2.1 time: 0.074847 Jan 27 16:02:50.065063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:49 2022] GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:50.119087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117865153", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "428491c7-1dfc-4e6f-a1ce-ef805c994d7c"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:02:50.184072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] validate_networks() for [('428491c7-1dfc-4e6f-a1ce-ef805c994d7c', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:02:50.717448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1854d07f-ff8b-4af1-a1e4-cd002feef285 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:50.718172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1854d07f-ff8b-4af1-a1e4-cd002feef285 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:50.836234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1854d07f-ff8b-4af1-a1e4-cd002feef285 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:50.851000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1854d07f-ff8b-4af1-a1e4-cd002feef285 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1215 microversion: 2.1 time: 0.130820 Jan 27 16:02:50.851000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 7/12] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:50 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:02:50.864066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-60769baf-bc93-4442-a273-ccac5d89e6cd tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7814640310>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:50.926860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-60769baf-bc93-4442-a273-ccac5d89e6cd tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 200 len: 346 microversion: 2.1 time: 0.080508 Jan 27 16:02:50.934462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 8/13] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:50 2022] GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:50.940123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ca86a151-4366-44c1-b33b-76d579e3fe6a tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Action: 'create', calling method: .version_select at 0x7f7814642550>, body: {"snapshot": {"volume_id": "08c5b2ce-b996-4840-979d-9eb8e3081bbe", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2067052636"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:02:51.315646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ca86a151-4366-44c1-b33b-76d579e3fe6a tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.380198 Jan 27 16:02:51.316520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 9/14] 10.222.0.61 () {60 vars in 1161 bytes} [Thu Jan 27 16:02:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:02:51.321958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-808a51ef-edb9-4e9d-afe2-dfbd31ff6a83 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Calling method '.version_select at 0x7f7814642e50>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:51.377493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-808a51ef-edb9-4e9d-afe2-dfbd31ff6a83 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] HTTP exception thrown: Volume fe421374-12d8-4af4-be9b-e40dea9e4084 could not be found. Jan 27 16:02:51.378116 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-808a51ef-edb9-4e9d-afe2-dfbd31ff6a83 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] Returning 404 to user: Volume fe421374-12d8-4af4-be9b-e40dea9e4084 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:02:51.379014 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-808a51ef-edb9-4e9d-afe2-dfbd31ff6a83 tempest-VolumesGetTestJSON-1704309626 tempest-VolumesGetTestJSON-1704309626-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084" status: 404 len: 109 microversion: 2.1 time: 0.061300 Jan 27 16:02:51.379575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 10/15] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:51 2022] GET /compute/v2.1/os-volumes/fe421374-12d8-4af4-be9b-e40dea9e4084 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:02:51.388290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-514eabcf-a656-4a8c-801d-b5105aa37425 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f78146e5dc0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:51.434881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-514eabcf-a656-4a8c-801d-b5105aa37425 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.054202 Jan 27 16:02:51.435628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 11/16] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:51 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:51.445897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ad33065c-c050-4b54-9ab4-3c9b61670229 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f78146e5940>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:51.518219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ad33065c-c050-4b54-9ab4-3c9b61670229 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.076850 Jan 27 16:02:51.519007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 12/17] 10.222.0.61 () {58 vars in 1139 bytes} [Thu Jan 27 16:02:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:51.530293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a3917d66-2b83-4ff2-a523-fcef8420e537 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f78146421f0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:51.583938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a3917d66-2b83-4ff2-a523-fcef8420e537 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.057836 Jan 27 16:02:51.585185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 13/18] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:51 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:02:51.730584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:02:51.731327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:02:51.732214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:02:51.732803 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:02:51.733478 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:02:51.743513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:51.744293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:51.747911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:51.748592 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:51.794635 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:02:51.800658 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for user 4a8173ea1633470785f53cd6fc0e9e77 and project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:02:51.835859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:02:51.840131 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:02:51.866945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:51.867870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:51.877855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:51.878308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:51.879132 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:51.879568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:51.929464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-756ec1d6-2a18-4429-af9c-8d075ee1da6a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894613 Jan 27 16:02:51.933816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 6/19] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:02:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:02:51.945346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cb572b17-6e97-4919-ad91-1d29165dfc2e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:51.947124 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cb572b17-6e97-4919-ad91-1d29165dfc2e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:52.163507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-cb572b17-6e97-4919-ad91-1d29165dfc2e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:52.183719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cb572b17-6e97-4919-ad91-1d29165dfc2e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1218 microversion: 2.1 time: 0.242967 Jan 27 16:02:52.185483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 7/20] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:51 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:02:52.610557 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-81ac3391-2f81-4b3d-8dc2-5da9a4d1fd9d tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7813da0280>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:52.722933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-81ac3391-2f81-4b3d-8dc2-5da9a4d1fd9d tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.130174 Jan 27 16:02:52.724173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 8/21] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:52 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:52.777392 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:52.801208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b512bf33-1751-4b2e-bfaf-7ac0fa8dd10a tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1267 microversion: 2.1 time: 0.937794 Jan 27 16:02:52.806453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 14/22] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:51 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1267 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:53.207644 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:53.209034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:53.228387 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:53.229129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:53.230346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:53.230949 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:53.423940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:53.447552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5254ed32-ee25-4e22-babc-53b8a4064ea7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1222 microversion: 2.1 time: 0.243741 Jan 27 16:02:53.459194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 9/23] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:53 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:02:53.747334 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6b6e0672-e462-4c3c-8eb4-90c5431d7227 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7814569f70>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:53.822518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6b6e0672-e462-4c3c-8eb4-90c5431d7227 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.089555 Jan 27 16:02:53.823128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 15/24] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:53 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:53.825776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:53.826276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:53.857740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:53.858825 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:53.861849 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:53.862703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:54.147878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:54.158957 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-21065b05-c53b-4682-a910-1768422f924c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1267 microversion: 2.1 time: 0.341184 Jan 27 16:02:54.180830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 10/25] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:53 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:02:54.468327 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:54.469621 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:54.485920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:54.488173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:54.491515 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:54.492468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:54.722133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:54.741115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-154626c6-c394-444f-ac72-64fe63bb7b93 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1222 microversion: 2.1 time: 0.274911 Jan 27 16:02:54.759635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 16/26] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:54 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1222 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:02:54.834219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ef32e8a8-6627-4d53-b59a-35534f547325 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7813470f70>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:54.891234 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ef32e8a8-6627-4d53-b59a-35534f547325 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.060640 Jan 27 16:02:54.896171 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 11/27] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:54 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:55.191459 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:55.192518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:55.211293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:55.215852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:55.220780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:55.222766 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:55.335939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:55.343530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b124c74a-a224-4f10-954a-84f035e1acc6 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1267 microversion: 2.1 time: 0.159487 Jan 27 16:02:55.344103 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 17/28] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:55 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:55.762369 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:55.763237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:55.781047 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:55.791085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:55.795589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:55.797672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:55.902387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-042fa86a-aa02-406b-a690-db0b7ff2dacb tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f781459a940>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:55.961523 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-042fa86a-aa02-406b-a690-db0b7ff2dacb tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.063272 Jan 27 16:02:55.962091 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 18/29] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:55 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:02:56.064719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:56.077376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-03048971-fe0e-42f1-8b99-7e9e0b11df47 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1222 microversion: 2.1 time: 0.321188 Jan 27 16:02:56.083953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 12/30] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:55 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:56.362414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:56.363102 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:56.381532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:56.382326 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:56.383389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:56.389225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:56.569009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:56.578199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a4ac8077-97b0-491a-aef2-001ab1baa6b9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1267 microversion: 2.1 time: 0.220264 Jan 27 16:02:56.582212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 19/31] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:56 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:56.975625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4ced349e-ed32-4f2b-9525-0207096a3b51 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f781353c280>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:57.033315 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4ced349e-ed32-4f2b-9525-0207096a3b51 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.060584 Jan 27 16:02:57.039841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 13/32] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:56 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:57.100852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:57.102130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:57.119329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:57.121425 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:57.123673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:57.124990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:57.445989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:57.456868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5ebdf23c-f951-4a87-8a9a-0f4f7a4a06d3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1214 microversion: 2.1 time: 0.359719 Jan 27 16:02:57.461015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 20/33] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:57 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1214 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:57.603318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:57.604733 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:57.620676 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:57.621310 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:57.623698 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:57.624358 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:58.045394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-77dd24c6-80bc-40b5-ac86-58aa9f5d87a8 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7814569f70>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:58.101017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-77dd24c6-80bc-40b5-ac86-58aa9f5d87a8 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 288 microversion: 2.1 time: 0.059614 Jan 27 16:02:58.102517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 21/34] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:58 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 288 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:02:58.113057 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5f946484-af59-4a99-9760-fbccf0317104 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7814640820>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:58.244113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5f946484-af59-4a99-9760-fbccf0317104 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 202 len: 0 microversion: 2.1 time: 0.134811 Jan 27 16:02:58.247777 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 22/35] 10.222.0.61 () {58 vars in 1253 bytes} [Thu Jan 27 16:02:58 2022] DELETE /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:02:58.252795 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5a8c7531-5936-4114-a21c-4431ff201403 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7814530940>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:58.321252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5a8c7531-5936-4114-a21c-4431ff201403 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 200 len: 287 microversion: 2.1 time: 0.072191 Jan 27 16:02:58.322189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 23/36] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:58 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:02:58.397922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:58.434125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e68fcf8e-389b-425d-a694-8dd790111e8c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1275 microversion: 2.1 time: 0.839051 Jan 27 16:02:58.450266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 14/37] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:57 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1275 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:58.477432 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:58.479334 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:58.503528 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:58.504030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:58.510588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:58.511887 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:59.008932 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:02:59.017335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-652aa19f-3fcf-4ff1-a12b-1c07624ffdb4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1276 microversion: 2.1 time: 0.544327 Jan 27 16:02:59.025730 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 24/38] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:58 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1276 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:02:59.333960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-178846d2-b3e6-49c4-a5a6-75b737df676b tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7813470790>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:59.405192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-178846d2-b3e6-49c4-a5a6-75b737df676b tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] HTTP exception thrown: Snapshot 90529328-37b0-4afc-9ea0-9ed3e1df567c could not be found. Jan 27 16:02:59.406387 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-178846d2-b3e6-49c4-a5a6-75b737df676b tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Returning 404 to user: Snapshot 90529328-37b0-4afc-9ea0-9ed3e1df567c could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:02:59.407259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-178846d2-b3e6-49c4-a5a6-75b737df676b tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c" status: 404 len: 111 microversion: 2.1 time: 0.077631 Jan 27 16:02:59.407808 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 15/39] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jan 27 16:02:59 2022] GET /compute/v2.1/os-snapshots/90529328-37b0-4afc-9ea0-9ed3e1df567c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:02:59.416009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c1e193f8-571c-4f86-8313-2594208707c8 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7814640ee0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:59.454629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:59.456027 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:02:59.484018 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:59.484519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:59.491228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:02:59.491714 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:02:59.614171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c1e193f8-571c-4f86-8313-2594208707c8 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 202 len: 0 microversion: 2.1 time: 0.201881 Jan 27 16:02:59.618825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 25/40] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jan 27 16:02:59 2022] DELETE /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:02:59.623540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-424c0591-2845-42e6-a7fa-69f5b63bf969 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f78145d2b80>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:02:59.752631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-424c0591-2845-42e6-a7fa-69f5b63bf969 tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 200 len: 345 microversion: 2.1 time: 0.132503 Jan 27 16:02:59.758868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 26/41] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:02:59 2022] GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:03:00.045390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:00.046239 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:00.056032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:00.056779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:00.057720 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:00.058294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:00.233125 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:00.248364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b55a69f0-3f56-45f8-9c5c-8b50b6d4f12f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1276 microversion: 2.1 time: 0.203402 Jan 27 16:03:00.251119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 27/42] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:00 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:00.650357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:00.660409 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-508a500b-6131-422d-8ec5-2ed1c6f920eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1273 microversion: 2.1 time: 1.210496 Jan 27 16:03:00.665577 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 16/43] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:02:59 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1273 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:00.766286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3d9c2fa3-d642-4e66-b4aa-8154de623aca tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7813476940>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:00.827924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-3d9c2fa3-d642-4e66-b4aa-8154de623aca tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] HTTP exception thrown: Volume 08c5b2ce-b996-4840-979d-9eb8e3081bbe could not be found. Jan 27 16:03:00.828528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3d9c2fa3-d642-4e66-b4aa-8154de623aca tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Returning 404 to user: Volume 08c5b2ce-b996-4840-979d-9eb8e3081bbe could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:03:00.829513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3d9c2fa3-d642-4e66-b4aa-8154de623aca tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 404 len: 109 microversion: 2.1 time: 0.067071 Jan 27 16:03:00.839549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 17/44] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:03:00 2022] GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:03:00.891795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-af4b6560-0bde-40ed-bfac-f1d902c03a9d tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7813495550>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:00.971672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-af4b6560-0bde-40ed-bfac-f1d902c03a9d tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] HTTP exception thrown: Volume 08c5b2ce-b996-4840-979d-9eb8e3081bbe could not be found. Jan 27 16:03:00.972302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-af4b6560-0bde-40ed-bfac-f1d902c03a9d tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Returning 404 to user: Volume 08c5b2ce-b996-4840-979d-9eb8e3081bbe could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:03:00.975434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-af4b6560-0bde-40ed-bfac-f1d902c03a9d tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 404 len: 109 microversion: 2.1 time: 0.129868 Jan 27 16:03:00.979673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 18/45] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jan 27 16:03:00 2022] DELETE /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:03:01.019114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f3754dd7-f9f7-4aed-afc1-953a0197c09a tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Calling method '.version_select at 0x7f7813470790>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:01.064893 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-f3754dd7-f9f7-4aed-afc1-953a0197c09a tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] HTTP exception thrown: Volume 08c5b2ce-b996-4840-979d-9eb8e3081bbe could not be found. Jan 27 16:03:01.065968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f3754dd7-f9f7-4aed-afc1-953a0197c09a tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] Returning 404 to user: Volume 08c5b2ce-b996-4840-979d-9eb8e3081bbe could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:03:01.066951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f3754dd7-f9f7-4aed-afc1-953a0197c09a tempest-VolumesSnapshotsTestJSON-608483347 tempest-VolumesSnapshotsTestJSON-608483347-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe" status: 404 len: 109 microversion: 2.1 time: 0.086294 Jan 27 16:03:01.071677 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 19/46] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:03:00 2022] GET /compute/v2.1/os-volumes/08c5b2ce-b996-4840-979d-9eb8e3081bbe => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:03:01.267460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:01.272009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:01.291141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:01.292784 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:01.296831 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:01.300267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:01.402005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ca8636c4-a6ee-4478-be15-2b701ded40a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'create', calling method: .version_select at 0x7f78145ba9d0>, body: {"keypair": {"name": "tempest-keypair-354944945"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:01.599968 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-ca8636c4-a6ee-4478-be15-2b701ded40a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:01.637963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-ca8636c4-a6ee-4478-be15-2b701ded40a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for user 1e42712b632b4a83848a75e00f258c65 and project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:01.823540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:01.836886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ab79cd09-f2eb-48d5-a485-e0ac5509928b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1276 microversion: 2.1 time: 0.568751 Jan 27 16:03:01.842712 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 20/47] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:01 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1276 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:01.854204 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:01.863871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:01.883691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:01.885177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:01.886201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:01.886962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:02.167975 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-ca8636c4-a6ee-4478-be15-2b701ded40a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:02.237780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-ca8636c4-a6ee-4478-be15-2b701ded40a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for user 1e42712b632b4a83848a75e00f258c65 and project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:02.367378 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ca8636c4-a6ee-4478-be15-2b701ded40a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.796681 Jan 27 16:03:02.382057 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 28/48] 10.222.0.61 () {62 vars in 1198 bytes} [Thu Jan 27 16:03:00 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1812 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:03:02.859893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:02.861236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:02.885306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:02.890782 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:02.891902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:02.894390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:03.057442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:03.069301 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3a634921-144a-4027-93b4-b331e0f78756 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1273 microversion: 2.1 time: 1.225196 Jan 27 16:03:03.069895 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 21/49] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:01 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1273 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:03.116573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:03.128305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a1e58484-a108-42a3-9e91-202c000f95e8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1276 microversion: 2.1 time: 0.272574 Jan 27 16:03:03.131159 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 29/50] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:02 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:04.088800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:04.090193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:04.113547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:04.116080 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:04.117100 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:04.117935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:04.147462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:04.149059 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:04.158790 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:04.163125 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:04.164494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:04.166660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:04.494461 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:04.504274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fe2ad95d-d708-4a1e-9079-62cd9d906dda tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1276 microversion: 2.1 time: 0.360864 Jan 27 16:03:04.504864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 30/51] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:04 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1276 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:04.794820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:04.807408 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d03757dd-7b73-4070-b1d5-e5586b75eb7c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1273 microversion: 2.1 time: 0.722214 Jan 27 16:03:04.817498 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 22/52] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:04 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1273 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:05.522215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:05.522820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:05.530917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:05.531764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:05.540925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:05.541607 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:05.742398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:05.758021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8a7af779-f125-48f5-9415-9dd8846a5361 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1276 microversion: 2.1 time: 0.237964 Jan 27 16:03:05.763139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 31/53] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:05 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:05.824954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:05.825738 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:05.835342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:05.852506 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:05.853415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:05.853862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:06.780521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:06.781388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:06.801443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:06.803047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:06.804800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:06.805240 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:07.051616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:07.065223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0c939cc7-71d8-44c7-b7e3-65389589933e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.292434 Jan 27 16:03:07.066357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 32/54] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:06 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:07.101350 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:07.128378 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8d4ef2da-b6c1-4ea4-b826-862785c599af tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 1.305743 Jan 27 16:03:07.132277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 23/55] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:05 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:08.085300 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:08.087284 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:08.114159 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:08.116635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:08.121871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:08.124856 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:08.144917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:08.146595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:08.189220 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:08.189955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:08.192317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:08.203167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:08.462917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:08.474519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ee8c70f4-0cd3-49c4-a7c9-5b2e200c5b48 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.395708 Jan 27 16:03:08.482123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 33/56] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:08 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:09.704615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:09.715844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fdb5c5e5-ebc9-426a-8e7a-887682a4be57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 1.572988 Jan 27 16:03:09.718663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 24/57] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:08 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:09.732128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:09.733113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:09.752064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:09.766636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:09.771856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:09.772542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:09.877581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-107419215", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:10.024442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] validate_networks() for [('a99e79c7-9b98-4a4c-90ca-45b97bd488ec', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:03:10.068686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:10.082158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-445ea4c0-41da-4cad-a959-55bbcd77570d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.361130 Jan 27 16:03:10.082732 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 25/58] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:09 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:10.222920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d31ecc50-7fd0-4901-b7b4-eccd0d721183 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'create', calling method: .version_select at 0x7f78134959d0>, body: {"keypair": {"name": "tempest-keypair-1971212329"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:10.264995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-d31ecc50-7fd0-4901-b7b4-eccd0d721183 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:10.275337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-d31ecc50-7fd0-4901-b7b4-eccd0d721183 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for user 94ac7389bd7d48c7bdd305cb27558952 and project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:10.538371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-d31ecc50-7fd0-4901-b7b4-eccd0d721183 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:10.542889 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-d31ecc50-7fd0-4901-b7b4-eccd0d721183 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for user 94ac7389bd7d48c7bdd305cb27558952 and project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:10.559162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d31ecc50-7fd0-4901-b7b4-eccd0d721183 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.474332 Jan 27 16:03:10.561465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 26/59] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Jan 27 16:03:10 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:10.604231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1278171323", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ac1415e-ce93-45b8-8b83-dca773596e87"}], "security_groups": [{"name": "tempest-securitygroup--1231966802"}], "key_name": "tempest-keypair-354944945", "user_data": "}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:11.183649 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] validate_networks() for [('3ac1415e-ce93-45b8-8b83-dca773596e87', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:03:12.486934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:03:12.487455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:03:12.487856 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:03:12.488476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:03:12.489032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:03:12.513472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:12.516506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:12.523443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:12.524083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:12.611970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Getting quotas for project 8a2429eb90c34664ac6a690662ded8d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:12.627015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Getting quotas for user c733accb508546dd9c89a037208d4592 and project 8a2429eb90c34664ac6a690662ded8d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:12.663948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:03:12.679388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:03:12.980499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:03:12.982101 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:03:12.983443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:03:12.984142 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:03:12.985297 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:03:12.998805 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-89b2bb91-0058-4e6d-9493-3fdc03bea777 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.525428 Jan 27 16:03:12.999877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 34/60] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:03:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 27 16:03:13.009432 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:13.009613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:13.010320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:13.010679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:13.011772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:13.014483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:13.024992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:13.025458 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:13.030586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:13.031577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:13.082071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:13.116915 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for user 1e42712b632b4a83848a75e00f258c65 and project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:13.164605 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:03:13.184607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:03:13.402165 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bc6f4399-c3c6-4d11-a45f-da8548494771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.839099 Jan 27 16:03:13.411536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 27/61] 10.222.0.61 () {62 vars in 1187 bytes} [Thu Jan 27 16:03:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 27 16:03:13.429686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:13.430482 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:13.449332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:13.450092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:13.454015 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:13.455915 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:13.796051 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:13.833871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2a07185d-9aba-4148-98c2-905ff0cc81f9 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.831247 Jan 27 16:03:13.837055 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 35/62] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:12 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:13.874195 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f3f52b0d-b08a-489a-bf92-cc0d12bb427e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:13.874848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f3f52b0d-b08a-489a-bf92-cc0d12bb427e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:14.143772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f3f52b0d-b08a-489a-bf92-cc0d12bb427e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:14.154607 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f3f52b0d-b08a-489a-bf92-cc0d12bb427e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1221 microversion: 2.1 time: 0.307152 Jan 27 16:03:14.155715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 36/63] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:13 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1221 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:14.165142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c8b47deb-90c6-40c9-83e1-0db2ebfeb548 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:14.175684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c8b47deb-90c6-40c9-83e1-0db2ebfeb548 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:14.623372 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c8b47deb-90c6-40c9-83e1-0db2ebfeb548 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:14.637188 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c8b47deb-90c6-40c9-83e1-0db2ebfeb548 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:14.640506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c8b47deb-90c6-40c9-83e1-0db2ebfeb548 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:14.652947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c8b47deb-90c6-40c9-83e1-0db2ebfeb548 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1281 microversion: 2.20 time: 0.487334 Jan 27 16:03:14.653609 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 37/64] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:14 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1281 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:14.673010 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1625856358", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:14.804075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] validate_networks() for [('a99e79c7-9b98-4a4c-90ca-45b97bd488ec', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:03:15.134118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:15.148480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5fa2fc35-d1fe-43a7-8eac-70a6d9a599f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 1.735381 Jan 27 16:03:15.162757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 28/65] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:13 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:15.170625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:15.181674 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:15.196878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:15.197481 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:15.198425 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:15.199051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:15.664360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:15.674651 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6c45a690-49d4-4b22-b252-d96d4b07e266 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.510227 Jan 27 16:03:15.675517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 29/66] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:15 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:15.680956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:15.691864 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:15.706435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:15.707399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:15.708910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:15.709520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:15.794023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:03:15.794737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:03:15.795522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:03:15.796177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:03:15.796761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:03:15.814866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:15.816102 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:15.817087 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:15.817731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:15.835439 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:15.845333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:15.853702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:15.855910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-977adbdc-178f-4897-a15d-77125ff96f4a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1285 microversion: 2.20 time: 0.178390 Jan 27 16:03:15.857213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Getting quotas for project 8a2429eb90c34664ac6a690662ded8d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:15.857893 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 30/67] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:15 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:15.862526 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Getting quotas for user c733accb508546dd9c89a037208d4592 and project 8a2429eb90c34664ac6a690662ded8d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:15.876324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:03:15.878923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:03:15.955243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cfd3c4b5-9afb-4e81-b748-bbf19e3eee7a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.300016 Jan 27 16:03:15.956233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 38/68] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:03:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:03:15.966965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6aa800e8-6ea0-4101-8130-99b787bd08ac tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:15.967798 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6aa800e8-6ea0-4101-8130-99b787bd08ac tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:16.172991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:16.173671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:16.183171 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6aa800e8-6ea0-4101-8130-99b787bd08ac tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:16.190548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6aa800e8-6ea0-4101-8130-99b787bd08ac tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1222 microversion: 2.1 time: 0.227813 Jan 27 16:03:16.195535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 31/69] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:15 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:16.201741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:16.202450 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:16.206076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:16.218113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:16.500990 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-328632414", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bebbf3bc-5a24-4217-8b9c-919f8a6115ca"}], "security_groups": [{"name": "tempest-securitygroup--1688029037"}], "key_name": "tempest-keypair-1971212329", "user_data": "}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:16.642201 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:16.654455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1475f090-a4e9-4ecc-8e2a-773b969670de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.491457 Jan 27 16:03:16.666496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 39/70] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:16 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:16.711433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] validate_networks() for [('bebbf3bc-5a24-4217-8b9c-919f8a6115ca', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:03:16.741645 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-a4fa28d6-2982-42c6-9400-1f975fe5b048 req-aed89c37-ce3d-45a4-ad4c-0c776d039432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdcde5c-e6f9-45cc-9173-2a47cd7459ee", "tag": "9d581be4-aa99-4784-808d-72ecbb0595a4"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:16.743939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:03:16.743939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:03:16.759880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-a4fa28d6-2982-42c6-9400-1f975fe5b048 req-aed89c37-ce3d-45a4-ad4c-0c776d039432 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:16.760756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-a4fa28d6-2982-42c6-9400-1f975fe5b048 req-aed89c37-ce3d-45a4-ad4c-0c776d039432 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:16.793176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-a4fa28d6-2982-42c6-9400-1f975fe5b048 req-aed89c37-ce3d-45a4-ad4c-0c776d039432 service nova] Creating event network-changed:9d581be4-aa99-4784-808d-72ecbb0595a4 for instance 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee on hv-cinder-82635 Jan 27 16:03:16.794557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-a4fa28d6-2982-42c6-9400-1f975fe5b048 req-aed89c37-ce3d-45a4-ad4c-0c776d039432 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 27 16:03:16.798142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89fad28a-6398-4ad5-833a-c12665b5a23f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:16.798799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89fad28a-6398-4ad5-833a-c12665b5a23f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:16.800278 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89fad28a-6398-4ad5-833a-c12665b5a23f None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:16.801096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89fad28a-6398-4ad5-833a-c12665b5a23f None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:16.810833 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.compute.rpcapi [None req-89fad28a-6398-4ad5-833a-c12665b5a23f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 27 16:03:16.811819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89fad28a-6398-4ad5-833a-c12665b5a23f None None] Releasing lock "compute-rpcapi-router" {{(pid=116260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 27 16:03:16.831593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-89fad28a-6398-4ad5-833a-c12665b5a23f None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160129 Jan 27 16:03:16.832818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 40/71] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:03:16.841693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:16.842914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:16.850945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:16.851536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:16.852517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:16.853365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.015609 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:17.023309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1452ca33-d2dc-4e3d-aeca-ef1ec517819c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.188682 Jan 27 16:03:17.023905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 41/72] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:16 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:17.029153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:17.030066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:17.036959 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.037800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.038812 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.039413 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.108220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:17.118088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:17.120146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:17.121538 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c492fdb1-12e7-47e9-9bb1-4344d24fb45c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1285 microversion: 2.20 time: 0.096457 Jan 27 16:03:17.122208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 42/73] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:17 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:17.157978 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:03:17.158377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:03:17.158852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:03:17.159329 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:03:17.159749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:03:17.171342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.171809 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.172637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.173084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.190053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for project b245b789104749da9a1417bab1c186c6. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:03:17.193750 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for user 94ac7389bd7d48c7bdd305cb27558952 and project b245b789104749da9a1417bab1c186c6. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:03:17.205549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:03:17.207815 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:03:17.213660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:17.214440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:17.221606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.222365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.224143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.224868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.266727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d4b32d3c-1d86-4b45-a4cb-c11cacaf303a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770111 Jan 27 16:03:17.267721 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 32/74] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:03:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 27 16:03:17.277887 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fe237b46-e553-4176-84fe-8963e0e9f120 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:17.278749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fe237b46-e553-4176-84fe-8963e0e9f120 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:17.337170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:17.354944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-858d1b31-5414-4b1a-b0f8-be87d83c5275 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1226 microversion: 2.1 time: 0.138023 Jan 27 16:03:17.365558 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 43/75] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:17 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1226 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:17.443276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fe237b46-e553-4176-84fe-8963e0e9f120 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:17.451422 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fe237b46-e553-4176-84fe-8963e0e9f120 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1237 microversion: 2.1 time: 0.177246 Jan 27 16:03:17.452291 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 33/76] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:17 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1237 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:17.673097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:17.673686 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:17.680435 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.680840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.681542 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:17.682230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:17.870412 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:17.879347 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-06b89713-a857-4f46-a772-61604fe3356c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.210236 Jan 27 16:03:17.880953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 44/77] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:17 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:18.041632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:18.042554 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:18.049331 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.049802 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.050841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.051334 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.140568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:18.141185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:18.157963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.159164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.160494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.165654 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.215733 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:18.230758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-514b303f-1e83-4ee7-bdf2-84fca23e3e37 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.192891 Jan 27 16:03:18.231768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 34/78] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:18 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:18.266367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:18.274746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:18.276279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:18.277581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a638e24d-5a98-43a0-be80-d4e8c6317a7a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1285 microversion: 2.20 time: 0.141970 Jan 27 16:03:18.278281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 45/79] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:18 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:18.373873 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:18.374566 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:18.385057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.385527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.386364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.386816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.470189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:18.470639 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:18.485534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.488811 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.492145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.492593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.537942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:18.571803 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-409e21da-9aca-4a4f-a66f-c27037b6026f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1226 microversion: 2.1 time: 0.181010 Jan 27 16:03:18.579182 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 35/80] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:18 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1226 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:18.604616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:18.613782 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-864e57cf-a2c7-4599-a019-ee938d2f73f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1233 microversion: 2.1 time: 0.148235 Jan 27 16:03:18.615937 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 46/81] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:18 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1233 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:18.885596 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-d067dee0-d254-46ca-9467-5a78a3c922df req-b4874346-616a-49dc-8685-beb3521a25e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c098b0b1-0d8f-4c24-8c24-721f965786f4", "tag": "e530d2d9-0967-4022-9957-d2c0df7e0250"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:18.888343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:03:18.888343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:03:18.902518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:18.903742 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:18.907538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-d067dee0-d254-46ca-9467-5a78a3c922df req-b4874346-616a-49dc-8685-beb3521a25e1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.910822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.912044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-d067dee0-d254-46ca-9467-5a78a3c922df req-b4874346-616a-49dc-8685-beb3521a25e1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.912634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.913708 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.923676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.948249 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-d067dee0-d254-46ca-9467-5a78a3c922df req-b4874346-616a-49dc-8685-beb3521a25e1 service nova] Creating event network-changed:e530d2d9-0967-4022-9957-d2c0df7e0250 for instance c098b0b1-0d8f-4c24-8c24-721f965786f4 on hv-cinder-82635 Jan 27 16:03:18.948783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-d067dee0-d254-46ca-9467-5a78a3c922df req-b4874346-616a-49dc-8685-beb3521a25e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116261) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 27 16:03:18.949912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aa9a6bfd-2124-4aa9-88d5-9614b8dbdd5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.950354 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aa9a6bfd-2124-4aa9-88d5-9614b8dbdd5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.951181 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aa9a6bfd-2124-4aa9-88d5-9614b8dbdd5d None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:18.951612 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aa9a6bfd-2124-4aa9-88d5-9614b8dbdd5d None None] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:18.961528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.compute.rpcapi [None req-aa9a6bfd-2124-4aa9-88d5-9614b8dbdd5d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 27 16:03:18.962413 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aa9a6bfd-2124-4aa9-88d5-9614b8dbdd5d None None] Releasing lock "compute-rpcapi-router" {{(pid=116261) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 27 16:03:18.981231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-aa9a6bfd-2124-4aa9-88d5-9614b8dbdd5d None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098892 Jan 27 16:03:18.982935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 36/82] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:03:19.076100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:19.083759 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c922ae51-af2b-4983-96f6-509063bd99a8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.184714 Jan 27 16:03:19.084338 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 47/83] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:18 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:19.250178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:19.250845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:19.265889 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:19.267285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:19.269044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:19.269895 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:19.297297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:19.298005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:19.322633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:19.326204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:19.327861 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:19.329012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:19.514010 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:19.531918 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:19.535871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:19.538826 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d6f4b766-af8a-42de-937e-c829556fa695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1333 microversion: 2.20 time: 0.245785 Jan 27 16:03:19.543661 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 48/84] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:19 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1333 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:19.589721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:19.590593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:19.605484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:19.610442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:19.611623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:19.615291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:19.923584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:19.940026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7513c89c-b659-416f-8fbe-106c7dfe3cc8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1282 microversion: 2.1 time: 0.351936 Jan 27 16:03:19.951448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 49/85] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:19 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1282 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:19.977686 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:19.979830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:20.006057 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.007509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:20.009911 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.010577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:20.208235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:20.230650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-851b4d4e-37e5-4b79-b79b-1835ecec6858 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1307 microversion: 2.1 time: 0.277328 Jan 27 16:03:20.231349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 50/86] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:19 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:20.248258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:20.260414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:20.263856 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:20.265311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5c0dcbc5-292f-44d3-8529-6a24f87c8cad tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 1.017466 Jan 27 16:03:20.268487 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 37/87] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:19 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:20.292509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.292992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:20.303338 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.304042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:20.599527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:20.603103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:20.651731 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.652625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:20.653725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.654388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:20.845841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:20.866520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:20.871284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:20.873906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ca9a3ed2-7f36-4c8c-a687-11ff26e3dbbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1339 microversion: 2.20 time: 0.307743 Jan 27 16:03:20.875366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 38/88] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:20 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:20.956696 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:20.957825 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:20.964578 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.965094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:20.965933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:20.966548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:21.050657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:21.063897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-377df23a-4983-4b44-ab7f-927ddbd4b250 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.814882 Jan 27 16:03:21.065468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 51/89] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:20 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:21.097123 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:21.110299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-323664ba-5231-445c-b38d-a86b71418861 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1280 microversion: 2.1 time: 0.157059 Jan 27 16:03:21.120238 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 39/90] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:20 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:21.251070 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:21.252689 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:21.262608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:21.263425 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:21.264474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:21.265177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:21.285796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:21.287634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:21.300278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:21.301131 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:21.302248 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:21.304646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:21.475578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:21.491020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d3001e69-901d-4809-b265-83a84f16267a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1295 microversion: 2.1 time: 0.241937 Jan 27 16:03:21.491971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 52/91] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:21 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1295 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:21.675007 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:21.685703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d7076ad5-975a-4e02-a1d8-e6acd26a0423 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.404022 Jan 27 16:03:21.688979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 40/92] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:21 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:21.897497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:21.899580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:21.920104 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:21.921902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:21.926516 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:21.927293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.083844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:22.084476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:22.097348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.098023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.099062 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.099931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.108360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:22.118831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:22.121521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:22.122997 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ede2620d-7d8e-4204-98e9-a067fe590dde tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1339 microversion: 2.20 time: 0.232419 Jan 27 16:03:22.124286 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 53/93] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:21 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1339 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:22.134905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:22.134905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:22.137530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.138128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.139380 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.139915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.281722 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:22.294681 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a31f079a-0894-4901-9d5b-dc18b2423d36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1280 microversion: 2.1 time: 0.168889 Jan 27 16:03:22.295308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 54/94] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:22 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:22.318255 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:22.327136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6a3e1b33-d849-40b6-b2b5-fa1e0bc43ac8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.249148 Jan 27 16:03:22.328135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 41/95] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:22 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:22.511256 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:22.512892 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:22.531624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.532423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.536537 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.537770 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.710914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:22.711615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:22.727203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.729276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.731097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:22.732401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:22.867049 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:22.883656 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-27e1e268-d6fa-428f-a152-cc7146e6f415 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.370444 Jan 27 16:03:22.884356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 55/96] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:22 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:22.929383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:22.943759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1d2fe493-74cc-439a-96ae-84af3d6bc6f7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.239215 Jan 27 16:03:22.944352 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 42/97] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:22 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:23.142311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:23.142891 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:23.149466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.149910 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.150684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.151139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.280653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:23.289232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:23.290746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:23.291869 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7d53d27f-1fb1-4627-ac49-d4941c62a5cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.153266 Jan 27 16:03:23.292424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 56/98] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:23 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:23.312539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:23.313148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:23.321345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.321960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.322617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.323080 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.351851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:23.352467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:23.358565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.359030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.359832 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.360272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.452789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:23.460632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-08339312-5e42-492a-bb9f-c27a931991ce tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.151654 Jan 27 16:03:23.461199 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 43/99] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:23 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:23.489042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:23.496737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-588cd8ea-b5c4-46e3-9889-f159f225b452 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.149011 Jan 27 16:03:23.497347 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 57/100] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:23 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:23.901047 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:23.901843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:23.909010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.909550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.910536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.911155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.961285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:23.961851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:23.968514 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.969078 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:23.970027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:23.970526 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:24.062322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:24.070944 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-01127b9f-a781-4fa3-b264-41de7c21b991 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.173815 Jan 27 16:03:24.071695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 44/101] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:23 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:24.110896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:24.119012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0a70f6a8-2dd3-42f8-b86b-8970e3de2771 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.161873 Jan 27 16:03:24.119613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 58/102] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:23 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:24.309949 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:24.310469 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:24.316415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:24.316873 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:24.317661 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:24.318121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:24.458064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:24.466223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:24.467777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:24.468918 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e3fc14b2-2af8-4415-b6ec-5bf87ed09ace tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.162789 Jan 27 16:03:24.469485 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 45/103] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:24 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:24.477879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:24.478485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:24.484580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:24.485029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:24.485812 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:24.486248 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:24.515962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:24.516532 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:24.522644 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:24.523122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:24.523902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:24.524329 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:24.628476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:24.637490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3c633fe7-b113-494f-a41b-076f52c0f235 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.163167 Jan 27 16:03:24.646966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 59/104] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:24 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:24.671285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:24.678519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-de0157af-e1e3-4edc-ba36-a2b21d70ef1b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.166163 Jan 27 16:03:24.679196 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 46/105] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:24 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:25.088399 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:25.089162 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:25.096079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.096527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:25.097308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.097749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:25.136668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:25.137426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:25.144273 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.144591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:25.145431 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.145868 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:25.248395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:25.257668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a61e4f86-3bfb-4a88-8ebb-5e7b77084bb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.172566 Jan 27 16:03:25.258441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 60/106] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:25 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:25.299244 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:25.307206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0de54eef-b53d-4e7f-8069-68b79241c6be tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.174249 Jan 27 16:03:25.307790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 47/107] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:25 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:25.488094 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:25.488627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:25.495863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.496314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:25.497100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.497541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:25.656653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:25.658638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:25.665768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.666352 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:25.667178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:25.667773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.080632 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:26.093209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:26.096540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:26.099806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9d4479dd-0dc2-4706-897a-bf5bb21c8e48 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.615324 Jan 27 16:03:26.101102 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 61/108] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:25 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:26.108828 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:26.109925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:26.118694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:26.120177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.122041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:26.122843 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.129089 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:26.139091 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b198eb82-166c-4a7a-8f3f-90ba2a3723c1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.487022 Jan 27 16:03:26.141847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 48/109] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:25 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:26.274953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:26.275594 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:26.283636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:26.284015 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.285077 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:26.286589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.554197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:26.569926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a389b878-9ce4-4ac7-8a20-600ae103c21c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.298503 Jan 27 16:03:26.570668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 49/110] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:26 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:26.575322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:26.575922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:26.589765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:26.590602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.592823 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:26.593535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.657755 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:26.670304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-35c4c803-3bdc-41f7-9a2a-5f70ab184efc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.565794 Jan 27 16:03:26.671868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 62/111] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:26 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:26.882088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:26.889860 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7eae5c07-1c29-4474-9276-058fd3909898 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.318120 Jan 27 16:03:26.891046 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 50/112] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:26 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:26.948522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-cc39d4f6-505f-4608-93db-8168d7877af9 req-911bf2b7-0ba7-4326-a030-6ded4e9a3dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3d80d1-f3b7-4435-853e-6c267367f0f9", "tag": "d2fdd9de-12ca-4356-8752-d36ccf10679b"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:26.951048 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:03:26.951048 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:03:26.964751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-cc39d4f6-505f-4608-93db-8168d7877af9 req-911bf2b7-0ba7-4326-a030-6ded4e9a3dd1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:26.965202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-cc39d4f6-505f-4608-93db-8168d7877af9 req-911bf2b7-0ba7-4326-a030-6ded4e9a3dd1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:26.985549 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-cc39d4f6-505f-4608-93db-8168d7877af9 req-911bf2b7-0ba7-4326-a030-6ded4e9a3dd1 service nova] Creating event network-changed:d2fdd9de-12ca-4356-8752-d36ccf10679b for instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 on hv-cinder-82635 Jan 27 16:03:26.993097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-cc39d4f6-505f-4608-93db-8168d7877af9 req-911bf2b7-0ba7-4326-a030-6ded4e9a3dd1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055966 Jan 27 16:03:26.996145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 63/113] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:03:27.118774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:27.120012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:27.145860 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.152961 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.155487 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.161139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.168933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:27.169863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:27.183657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.184204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.185088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.194173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.719946 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:27.734816 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-167eb028-4360-4365-a309-0e2e9cfb5761 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.577779 Jan 27 16:03:27.736828 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 64/114] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:27 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:27.739034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:27.746695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:27.748223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:27.750213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:27.752150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:27.753690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f5ee82e6-2067-448b-aa41-b90a56c3d42d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.638826 Jan 27 16:03:27.754950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 51/115] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:27 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:27.760575 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:27.761645 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:27.772091 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.772091 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.774631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.775091 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.775914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.776024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:27.776370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.776473 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:27.996162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:28.020654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-149dd577-1148-4924-88c6-a4b19cdb9b14 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.261498 Jan 27 16:03:28.023336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 52/116] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:27 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:28.044749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:28.046452 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:28.061558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:28.063495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:28.064551 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:28.068403 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:28.399223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:28.406995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fe813668-874b-4c3d-b4b0-18f3fe64ddc0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.668884 Jan 27 16:03:28.407583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 65/117] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:27 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:28.537669 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-75a507c2-4753-466f-90b8-8363ce1f83e5 req-ae044773-8c11-44cb-b85a-f983d499ca62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c1dfef-ceda-489a-a7ea-045b8ab0f249", "tag": "02126963-aa69-4146-be3b-fb8b3197466e"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:28.539215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:03:28.539215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:03:28.552076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-75a507c2-4753-466f-90b8-8363ce1f83e5 req-ae044773-8c11-44cb-b85a-f983d499ca62 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:28.553005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-75a507c2-4753-466f-90b8-8363ce1f83e5 req-ae044773-8c11-44cb-b85a-f983d499ca62 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:28.573246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-75a507c2-4753-466f-90b8-8363ce1f83e5 req-ae044773-8c11-44cb-b85a-f983d499ca62 service nova] Creating event network-changed:02126963-aa69-4146-be3b-fb8b3197466e for instance 53c1dfef-ceda-489a-a7ea-045b8ab0f249 on hv-cinder-82635 Jan 27 16:03:28.586625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-75a507c2-4753-466f-90b8-8363ce1f83e5 req-ae044773-8c11-44cb-b85a-f983d499ca62 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174210 Jan 27 16:03:28.587335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 66/118] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:03:28.635154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:28.645824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fb420f60-d67a-4387-aae9-42a9d2b41037 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.621041 Jan 27 16:03:28.656210 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 53/119] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:28 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:28.753714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:28.755068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:28.761967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:28.762622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:28.763489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:28.763926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:28.772462 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:28.773301 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:28.779927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:28.780679 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:28.781874 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:28.782538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:28.954752 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:28.963505 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:28.965008 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:28.966135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-60b5c891-a0c9-48dd-a7a9-584612d9210f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.198545 Jan 27 16:03:28.966690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 54/120] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:28 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:03:29.040318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:29.041006 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:29.047398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.047923 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:29.048799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.049333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:29.077341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:29.085324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-77487e50-e604-4ae2-9f35-9495b45e5637 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.336529 Jan 27 16:03:29.085895 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 67/121] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:28 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:29.186087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:29.194250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1782a9e3-e5c5-42e6-804c-9d6bb7a66aae tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.158533 Jan 27 16:03:29.194808 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 55/122] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:29 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:29.423741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:29.424654 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:29.431924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.432366 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:29.433151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.433587 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:29.565761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:29.573282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-85cf36a6-340f-4ce0-9fd0-20757546d827 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.153354 Jan 27 16:03:29.573866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 68/123] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:29 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:29.664140 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:29.664771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:29.670603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.671085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:29.671854 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.672289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:29.802572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:29.809885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-530e7509-6a3a-467c-964d-28b23351bf40 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.149978 Jan 27 16:03:29.810439 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 56/124] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:29 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:29.984670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:29.985287 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:29.991228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.991674 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:29.992446 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:29.992876 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.105245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:30.106062 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:30.112631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.113086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.113870 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.114332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.118486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:30.127194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:30.128813 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:30.130054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0cdbddaf-43a6-4c36-a14a-720f6d687471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.149008 Jan 27 16:03:30.130633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 69/125] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:29 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:30.211569 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:30.212184 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:30.219128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.219648 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.220812 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.221255 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.245052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:30.255397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d74e376a-ed87-4abd-bd9d-4056ab676202 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.154780 Jan 27 16:03:30.256002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 57/126] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:30 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:30.365188 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:30.373489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-506c4c34-26c6-4661-a751-e47ede712170 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.166501 Jan 27 16:03:30.374165 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 70/127] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:30 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:30.590179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:30.590898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:30.597525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.598037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.598841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.599318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.742012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:30.749623 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3a2c282f-7639-4972-b4b3-a2a244cafda4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.163414 Jan 27 16:03:30.750459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 58/128] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:30 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:30.798080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-96a03fe1-bc27-4904-a98f-bfbcf859e073 req-6284a7d7-07f0-423c-8a80-f2e3d5603805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb168b3-a714-4f0b-aca9-d23922390178", "tag": "7f3911ec-edec-4658-b029-6a522d1a3093"}, {"name": "network-changed", "server_uuid": "e56702b3-830c-441b-b790-b13f42d20c0d", "tag": "fdc1784f-018f-4bdb-9f4c-28700d25817c"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:30.799948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:03:30.799948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:03:30.808371 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-96a03fe1-bc27-4904-a98f-bfbcf859e073 req-6284a7d7-07f0-423c-8a80-f2e3d5603805 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.808820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-96a03fe1-bc27-4904-a98f-bfbcf859e073 req-6284a7d7-07f0-423c-8a80-f2e3d5603805 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.822422 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-96a03fe1-bc27-4904-a98f-bfbcf859e073 req-6284a7d7-07f0-423c-8a80-f2e3d5603805 service nova] Creating event network-changed:7f3911ec-edec-4658-b029-6a522d1a3093 for instance ffb168b3-a714-4f0b-aca9-d23922390178 on hv-cinder-82635 Jan 27 16:03:30.823083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-96a03fe1-bc27-4904-a98f-bfbcf859e073 req-6284a7d7-07f0-423c-8a80-f2e3d5603805 service nova] Creating event network-changed:fdc1784f-018f-4bdb-9f4c-28700d25817c for instance e56702b3-830c-441b-b790-b13f42d20c0d on hv-cinder-82635 Jan 27 16:03:30.826455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:30.827160 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:30.829646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-96a03fe1-bc27-4904-a98f-bfbcf859e073 req-6284a7d7-07f0-423c-8a80-f2e3d5603805 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035459 Jan 27 16:03:30.830469 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 71/129] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:03:30.836155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.836650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.837476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:30.837903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:30.973843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:30.984334 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d40f6b8f-d625-4f06-be14-9f55f616ae57 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.161556 Jan 27 16:03:30.984992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 59/130] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:30 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:31.149696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:31.150383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:31.156472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.156920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.157703 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.158133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.274283 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:31.274933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:31.281425 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.282003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.282815 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.283281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.312073 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:31.321160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:31.323143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:31.324582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9a0c3491-6847-44b7-9c1d-cb33afc1eee8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.179653 Jan 27 16:03:31.336760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 72/131] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:31 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:03:31.391394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:31.392027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:31.398843 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.399304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.400107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.400540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.431045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:31.438606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-29781b09-37ce-4ffe-b197-ca81b3855ba6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.168754 Jan 27 16:03:31.439143 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 60/132] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:31 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:31.531625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:31.540333 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-927bfb41-a9c1-4835-8b98-b03e9ffbb86c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.152409 Jan 27 16:03:31.541101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 73/133] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:31 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:31.767481 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:31.768083 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:31.774676 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.775177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.775963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:31.776429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:31.907288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:31.914426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-90a46986-482c-4408-ba44-12b2245f9cf1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.150606 Jan 27 16:03:31.915058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 61/134] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:31 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:32.001700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:32.002311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:32.009182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.009636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.010394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.010859 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.142367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:32.149611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1a070eaa-b442-4332-8024-62e67d0ad7dd tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.151868 Jan 27 16:03:32.150180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 74/135] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:31 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:32.344631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:32.345237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:32.351166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.351613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.352417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.352856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.454902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:32.456024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:32.462109 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.462647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.463604 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.464126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.493404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:32.502193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:32.503760 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:32.504817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-41eae47e-4be1-489d-ab12-8efe81bafd70 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.164503 Jan 27 16:03:32.505377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 62/136] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:32 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:32.557570 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:32.558169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:32.563957 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.564400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.565178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.565612 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.596658 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:32.607729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1dad5713-f7a6-4dd1-af16-c0928e1436f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.156489 Jan 27 16:03:32.608403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 75/137] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:32 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:32.702874 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:32.710328 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-362516c1-f4ee-4dc3-b505-3f63ffb41cfc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.156331 Jan 27 16:03:32.710920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 63/138] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:32 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:32.931587 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:32.932191 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:32.938112 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.938555 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:32.939361 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:32.939794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.069678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:33.076916 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7eae0bf7-ec54-4837-9650-eee4ca8e0883 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.149075 Jan 27 16:03:33.077571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 76/139] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:32 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:33.166940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:33.167563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:33.173450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.173900 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.174672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.175136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.306014 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:33.313275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8ec20193-9a44-404a-bab3-625e43346979 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.150069 Jan 27 16:03:33.313837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 64/140] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:33 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:33.523578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:33.524143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:33.530108 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.530552 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.531400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.531820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.632778 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:33.633843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:33.642201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.642776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.644263 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.644980 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.672439 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:33.680896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:33.682391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:33.683585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ac438cac-7a83-4716-bf3b-6333e246fd31 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.164446 Jan 27 16:03:33.684124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 77/141] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:33 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:33.727045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:33.727644 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:33.733888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.734341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.735190 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:33.735625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:33.785922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:33.795207 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3493d707-35ae-4847-94d9-575d121b3a58 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.170282 Jan 27 16:03:33.799773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 65/142] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:33 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:34.095773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:34.096473 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:34.103626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.104507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.105729 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.106342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.179124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:34.195489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3a0c6a1f-28e8-4d8f-8892-d02e0c6328d4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.471961 Jan 27 16:03:34.196289 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 78/143] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:33 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:34.325468 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:34.329746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:34.330426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:34.337886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.338857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.339991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.341016 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ac61ba33-b75d-4c67-a1f2-17facad91f1c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.248756 Jan 27 16:03:34.349479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.349653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 66/144] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:34 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:34.684536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:34.692518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-10713e01-aece-4dac-ac2f-b5ebfcf89ff2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.366655 Jan 27 16:03:34.693096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 79/145] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:34 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:34.701726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:34.702394 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:34.708398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.708839 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.709614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.710043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.817970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:34.819230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:34.826283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.827284 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.828424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:34.829013 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:34.844438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:34.855640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:34.857597 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:34.859465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9e8e6ddf-0417-427f-a140-a9ec2e33471b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.161255 Jan 27 16:03:34.860380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 67/146] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:34 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:03:35.211706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:35.212315 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:35.218076 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.218513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:35.219327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.219748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:35.259711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:35.267353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dcaf5004-748b-4629-b0c8-2b2c9612f501 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.454868 Jan 27 16:03:35.267931 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 80/147] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:34 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:35.351485 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:35.360068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:35.360675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:35.366948 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-968c6935-2007-44ca-ae0b-9a0e31854ec5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.158756 Jan 27 16:03:35.367263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.376591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 68/148] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:35 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:35.376813 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:35.376813 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.376813 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:35.575311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:35.582905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5cdf1107-1e75-4ea5-8b2d-1f8700bb1720 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.226512 Jan 27 16:03:35.583522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 81/149] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:35 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:35.710388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:35.711001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:35.717781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.718526 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:35.719508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.720117 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:35.879253 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:35.881519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:35.885756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:35.893125 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.894098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4cf13833-a5ef-4b72-ba6d-ad570b3bfdb1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.188054 Jan 27 16:03:35.895678 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 69/150] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:35 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:35.900005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:35.901422 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:35.902085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.193150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:36.202167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:36.203848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:36.205023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eaa6612d-8e4b-4725-a459-a23fdce27428 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.330898 Jan 27 16:03:36.205628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 82/151] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:35 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:03:36.284923 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:36.285883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:36.293141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.293912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.295632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.305320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.384582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:36.385192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:36.391117 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.391829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.392276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.392713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.443129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:36.450871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9d5ff92f-97d3-4e91-9260-ca4267136a1b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.170506 Jan 27 16:03:36.451474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 70/152] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:36 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:36.528550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:36.536044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c162c217-baf7-405f-9569-15c4ae0cc754 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.155157 Jan 27 16:03:36.536614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 83/153] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:36 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:36.600019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:36.600950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:36.607582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.608036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.608819 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.609272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.743158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:36.750563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2a5b45da-79c7-4c31-a863-4973d8a197d9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.154163 Jan 27 16:03:36.751350 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 71/154] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:36 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:36.911164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:36.911672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:36.917762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.918246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:36.919069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:36.919517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.056821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:37.064517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-94982a50-398e-4c9d-a0ae-15af35cef152 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.157060 Jan 27 16:03:37.065120 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 84/155] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:36 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:37.225000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:37.226242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:37.238844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.239380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.240175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.240606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.376586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:37.384383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:37.385875 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:37.386956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5b0c3216-b70a-4ccd-be4d-e2fa6779bdcf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.166841 Jan 27 16:03:37.387531 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 72/156] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:37 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:37.468354 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:37.468879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:37.475625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.476083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.476863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.477298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.552793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:37.553399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:37.559266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.559717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.560496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.560934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.607697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:37.614955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-586c97d8-ca86-48cd-aa57-4ec9317e61b2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.150314 Jan 27 16:03:37.615535 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 85/157] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:37 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:37.690254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:37.697534 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-33e50e66-f1a7-44a5-828c-b173cf35ccb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.148477 Jan 27 16:03:37.698098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 73/158] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:37 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:37.767329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:37.767885 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:37.774390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.774841 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.775661 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:37.776100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:37.906467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:37.913740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6264496c-f030-4c0b-9a50-e297415d2a02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.150418 Jan 27 16:03:37.914437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 86/159] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:37 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:38.081454 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:38.082578 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:38.088457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.088906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.089685 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.090127 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.216436 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:38.223589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e61e85e8-a7ad-4701-a4c6-e6118e7edb58 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.145879 Jan 27 16:03:38.224155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 74/160] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:38 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:38.416037 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:38.416641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:38.422776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.423254 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.424024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.424464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.553773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:38.562164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:38.564188 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:38.565293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1974647c-f42f-4a22-93c2-888cacaf9c6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.163564 Jan 27 16:03:38.565831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 87/161] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:38 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:38.632218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:38.632951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:38.639194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.639675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.640477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.640935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.717962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:38.719479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:38.730159 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.730741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.731510 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.731939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.794269 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:38.804512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3cee6007-aa43-4698-8478-87b17a5e1fa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.175953 Jan 27 16:03:38.805239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 75/162] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:38 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:38.891806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:38.900620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e9c856ce-fe3f-4d49-81b4-5ff436814aea tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.186259 Jan 27 16:03:38.901389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 88/163] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:38 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:38.929553 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:38.930146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:38.935993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.936437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:38.937203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:38.937633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.067183 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:39.074410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2560b26e-d848-4d6b-ba2f-2d5465c5960a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.148398 Jan 27 16:03:39.074968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 76/164] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:38 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:39.240678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:39.241187 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:39.247167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.247611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.248381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.248809 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.375189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:39.382801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3b8a5b7b-a671-49e7-b5af-28fd16602590 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.145823 Jan 27 16:03:39.383394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 89/165] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:39 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:39.584368 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:39.584971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:39.590796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.591278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.592048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.592483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.718366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:39.726542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:39.728132 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:39.729293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-573f2af3-8d6f-407a-9515-95fefee05d64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.149293 Jan 27 16:03:39.729883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 77/166] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:39 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:39.821866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:39.822474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:39.828422 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.828861 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.829624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.830054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.920411 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:39.921025 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:39.927326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.927775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.928555 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:39.928986 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:39.964326 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:39.971940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-da769b80-ee0d-412d-bf15-34fbb11841ab tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.153657 Jan 27 16:03:39.973088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 90/167] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:39 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:40.058525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:40.065605 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9fa39478-ac80-4617-a449-5081cbe015f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.148766 Jan 27 16:03:40.066202 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 78/168] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:39 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:40.094083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:40.095144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:40.104919 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.105636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:40.106723 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.107278 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:40.259324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:40.275351 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b22f6828-a04f-44ef-97dc-15d2149b66b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.186934 Jan 27 16:03:40.276138 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 91/169] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:40 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:40.400126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:40.400740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:40.407129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.407862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:40.408667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.409114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:40.550549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:40.558778 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-284ae989-f5d5-4e79-b6fa-249c1690a902 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.162156 Jan 27 16:03:40.559591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 79/170] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:40 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:40.748382 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:40.748990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:40.755985 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.756486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:40.757313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.757756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:40.895611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:40.904118 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:40.905626 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:40.906749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d88f3d8b-d1e0-41b1-86f0-bccb9a57eb9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.162374 Jan 27 16:03:40.907343 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 92/171] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:40 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:40.988821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:40.989427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:40.995765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.996218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:40.996998 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:40.997436 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.083092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:41.083928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:41.090059 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.090518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.091462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.091897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.139512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:41.146787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-790b845d-d13a-48b0-8d0b-4ecdd445bbb6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.161605 Jan 27 16:03:41.147687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 80/172] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:40 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:41.231689 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:41.239715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-635eeac0-58e0-4d16-9bcf-9e657ecaad5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.160727 Jan 27 16:03:41.240741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 93/173] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:41 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:41.292933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:41.293531 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:41.299657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.300105 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.301442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.301900 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.427481 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:41.434758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8d05bc75-05a4-4fe7-a9fe-05998a1c91d7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.145519 Jan 27 16:03:41.435353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 81/174] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:41 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:41.575561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:41.576192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:41.582179 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.582691 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.583439 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.583875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.734606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:41.742543 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-36d8d506-9ebb-4902-9136-04d90e3659b1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.170670 Jan 27 16:03:41.743155 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 94/175] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:41 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:41.925133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:41.925647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:41.931916 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.932366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:41.933137 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:41.933574 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.071626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:42.079753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:42.081256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:42.082912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d033359b-6042-4b36-8e3a-0c63d33da808 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.161583 Jan 27 16:03:42.083556 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 82/176] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:41 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:42.164339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:42.164941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:42.170899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.171376 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.172177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.172615 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.256909 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:42.257673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:42.264038 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.264544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.265377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.265818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.313915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:42.324362 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-aed5ecb3-3aad-4561-b1af-f222330fc7e2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.164228 Jan 27 16:03:42.325158 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 95/177] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:42 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:42.410173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:42.417495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-eacd5fed-728e-4809-adcd-6ae78c153893 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.164604 Jan 27 16:03:42.418064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 83/178] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:42 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:42.451972 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:42.452819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:42.459620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.460075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.460879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.461314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.596298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:42.604215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ec7e1ec8-b14c-41ed-af0e-e14c4bf0fa49 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.155951 Jan 27 16:03:42.604796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 96/179] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:42 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:42.758772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:42.759655 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:42.766282 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.766706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.767707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:42.768151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:42.905505 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:42.913806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0c3cc830-8ed5-4d54-9365-6e1361128bb5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.158715 Jan 27 16:03:42.914382 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 84/180] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:42 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:43.101711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:43.102302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:43.108100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.108535 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.109303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.109728 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.240719 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:43.248881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:43.250646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:43.251774 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1ea51509-98d2-4b49-86b3-54b2a7aba528 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.154327 Jan 27 16:03:43.252332 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 97/181] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:43 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:43.343355 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:43.344093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:43.351638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.352203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.353205 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.353679 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.436646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:43.437635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:43.447298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.447749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.448587 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.449269 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.506126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:43.513517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e05bc1f7-0779-4792-9dcd-7c392ea35b6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.175139 Jan 27 16:03:43.514092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 85/182] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:43 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:43.597581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:43.604915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-239107ca-8f0b-45de-9085-bf3d8868cfb0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.173285 Jan 27 16:03:43.605479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 98/183] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:43 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:43.621229 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:43.621829 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:43.629253 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.629253 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.630063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.630492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.776157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:43.783799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-54529240-719d-454d-a2e4-1418edebe637 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.166017 Jan 27 16:03:43.785164 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 86/184] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:43 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:43.932579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:43.933727 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:43.940045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.940481 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:43.941592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:43.942021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.111003 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:44.120256 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-75078450-a4df-4bc9-965c-7660cb61c1cf tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.191668 Jan 27 16:03:44.121072 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 99/185] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:43 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:44.274515 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:44.275605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:44.290068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.290340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.292768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.293246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.332735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-c91df025-c635-47d4-ae7a-e58dcbe1f53f req-b3fdf00b-a073-4269-8a27-08b8a8d69f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdcde5c-e6f9-45cc-9173-2a47cd7459ee", "name": "network-vif-plugged", "status": "completed", "tag": "9d581be4-aa99-4784-808d-72ecbb0595a4"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:44.338531 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:03:44.338531 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:03:44.345056 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-c91df025-c635-47d4-ae7a-e58dcbe1f53f req-b3fdf00b-a073-4269-8a27-08b8a8d69f98 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.345607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-c91df025-c635-47d4-ae7a-e58dcbe1f53f req-b3fdf00b-a073-4269-8a27-08b8a8d69f98 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.360338 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-c91df025-c635-47d4-ae7a-e58dcbe1f53f req-b3fdf00b-a073-4269-8a27-08b8a8d69f98 service nova] Creating event network-vif-plugged:9d581be4-aa99-4784-808d-72ecbb0595a4 for instance 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee on hv-cinder-82635 Jan 27 16:03:44.366094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-c91df025-c635-47d4-ae7a-e58dcbe1f53f req-b3fdf00b-a073-4269-8a27-08b8a8d69f98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118206 Jan 27 16:03:44.367344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 87/186] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:03:44.488541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:44.496900 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:44.498965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:44.500570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-77760733-e583-4b94-b997-f594fba8918e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.233824 Jan 27 16:03:44.501680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 100/187] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:44 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:44.535136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:44.536095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:44.543218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.543666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.544702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.545197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.621634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:44.622319 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:44.629870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.630232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.631371 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.632699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.711025 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:44.720231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b617c968-367b-49c5-9258-4b0946283b8f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.189377 Jan 27 16:03:44.723815 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 88/188] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:44 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:44.809260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:44.810596 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:44.822150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.823342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.824792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:44.825872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:44.839310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:44.850944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f8d2c419-cbe1-468e-b7fe-22740a937c3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.232121 Jan 27 16:03:44.852157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 101/189] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:44 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:44.990586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:44.998510 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-90aa4d57-bd42-4d18-9ef6-85054aac1bb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.200237 Jan 27 16:03:44.999549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 89/190] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:44 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:45.137371 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:45.138169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:45.144946 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.145711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.147071 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.147566 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.299690 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:45.307566 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b2f1e33a-0124-4ada-b471-9c7e991885ac tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.173725 Jan 27 16:03:45.308166 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 102/191] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:45 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:45.519433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:45.520017 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:45.525766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.526207 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.527012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.527434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.711102 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:45.719311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:45.720806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:45.721920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c8f43753-a414-4b86-a4fd-b31eb6724617 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.206180 Jan 27 16:03:45.723112 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 90/192] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:45 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:03:45.737390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:45.738133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:45.744704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.745279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.746257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.746657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.869550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:45.870354 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:45.878475 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.878927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.879822 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:45.880256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:45.886246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:45.894849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-649c6879-b450-406f-92e3-4242edb338d0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.161070 Jan 27 16:03:45.904708 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 103/193] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:45 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:46.014026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:46.016064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:46.016881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:46.023050 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-014180a0-4b28-4311-b35c-0c535974d9d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.158327 Jan 27 16:03:46.023730 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 91/194] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:45 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:46.023893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.024176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.025039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.026549 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.224711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:46.232119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c85be605-8781-4422-9bc7-b57c5e0977fd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.219690 Jan 27 16:03:46.232700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 104/195] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:46 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:46.324742 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:46.325307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:46.331855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.332294 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.333126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.335026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.391381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-00926f6c-b704-429f-8da0-4f720407031e req-c646df55-9280-4d87-98c3-86f52d868b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c098b0b1-0d8f-4c24-8c24-721f965786f4", "name": "network-vif-plugged", "status": "completed", "tag": "e530d2d9-0967-4022-9957-d2c0df7e0250"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:03:46.393025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:03:46.393025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:03:46.400669 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-00926f6c-b704-429f-8da0-4f720407031e req-c646df55-9280-4d87-98c3-86f52d868b77 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.401114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-00926f6c-b704-429f-8da0-4f720407031e req-c646df55-9280-4d87-98c3-86f52d868b77 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.414354 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-00926f6c-b704-429f-8da0-4f720407031e req-c646df55-9280-4d87-98c3-86f52d868b77 service nova] Creating event network-vif-plugged:e530d2d9-0967-4022-9957-d2c0df7e0250 for instance c098b0b1-0d8f-4c24-8c24-721f965786f4 on hv-cinder-82635 Jan 27 16:03:46.420991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-00926f6c-b704-429f-8da0-4f720407031e req-c646df55-9280-4d87-98c3-86f52d868b77 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033065 Jan 27 16:03:46.422039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 105/196] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:03:46.491934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:46.499521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1fffa6fd-7657-4a9d-87d0-da0f61094d32 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.178112 Jan 27 16:03:46.500086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 92/197] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:46 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:46.741247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:46.741977 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:46.748241 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.748691 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.749745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.750183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.891875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:46.900296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:46.901801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:46.903056 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0b5f13f5-cbc2-4e5c-a568-b8081d15ac06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.165701 Jan 27 16:03:46.903472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 106/198] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:46 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:46.914549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:46.915170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:46.921266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.921788 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:46.922638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:46.923175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.042045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:47.043110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:47.048991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.049364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.050189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.050623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.062948 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:47.071690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2362e2db-06b8-4866-a84a-f9daf8b08063 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.160836 Jan 27 16:03:47.072364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 93/199] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:46 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:47.193039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:47.200896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-23e94333-4e7b-4b5d-8cba-2bf4f3cb91d6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.162979 Jan 27 16:03:47.201479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 107/200] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:47 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:47.248455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:47.249191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:47.255904 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.256352 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.257144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.257576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.393497 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:47.400722 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b95eb3b9-57fe-48b8-9c52-6703c0c3bb86 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.156041 Jan 27 16:03:47.401319 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 94/201] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:47 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:47.515771 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:47.516370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:47.522284 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.522717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.523512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.523940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.754277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:47.763339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-97f8f304-20ea-4e1a-b59d-24c18df606e5 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.251019 Jan 27 16:03:47.764004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 108/202] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:47 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:47.921029 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:47.921727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:47.927857 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.928308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:47.929097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:47.929538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.088292 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:48.088893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:48.094645 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.095122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.095915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.096335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.111878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:48.119236 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:48.120748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:48.122067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-907fa1d7-403a-433d-8b12-8e1bcb889b60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.205010 Jan 27 16:03:48.122624 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 95/203] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:47 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:03:48.217268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:48.218194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:48.226101 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.226703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.227695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.228135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.285294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:48.294112 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c96dfee1-fd6a-4b5c-b738-83ff11d94c57 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.209446 Jan 27 16:03:48.294698 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 109/204] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:48 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:48.381513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:48.388840 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3fc63e0d-3afd-4888-89a3-8fd1c01e15b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.175193 Jan 27 16:03:48.389474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 96/205] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:48 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:48.416929 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:48.417532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:48.424218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.424666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.425509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.425952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.574143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:48.581627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-62d595f3-37cf-411e-8582-1f8a5f2e8456 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.168201 Jan 27 16:03:48.585780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 110/206] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:48 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:48.780527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:48.781129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:48.788573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.789027 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.789853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:48.790302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:48.942543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:48.950628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c2a37d5b-1945-4060-a2a1-c0172654daca tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.173630 Jan 27 16:03:48.951224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 97/207] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:48 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:49.139640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:49.140295 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:49.146033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.146482 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.147316 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.147753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.315648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:49.317064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:49.328024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.329133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.330733 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.332299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.348156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:49.361215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:49.363882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:49.366001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6988cbb0-b647-4245-8d96-dbb813bce88b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.229723 Jan 27 16:03:49.367039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 111/208] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:49 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:49.410204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:49.411409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:49.422354 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.423202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.424989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.426046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.524947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:49.533245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c1aaf587-3ff9-4852-b4d0-08eaa6750a51 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.224339 Jan 27 16:03:49.534254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 98/209] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:49 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:49.563168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:49.570485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7227b1d5-fe31-4c9d-a9d2-38699ce3ebd0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.167698 Jan 27 16:03:49.571175 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 112/210] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:49 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:49.599572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:49.600175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:49.606710 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.607273 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.608121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.608678 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.738859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:49.747705 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-261b1614-45be-4a1f-9579-d35bc8788772 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.152371 Jan 27 16:03:49.755176 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 99/211] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:49 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:49.967433 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:49.968040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:49.974258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.974701 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:49.975515 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:49.975976 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.105226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:50.113039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5878c679-1505-4a8c-a3a7-19080fce05e1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.148889 Jan 27 16:03:50.113598 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 113/212] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:49 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:50.384540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:50.385173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:50.391198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.391649 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.392426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.392861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.537804 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:50.545888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:50.547655 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:50.548992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7e9463b1-3d4e-4274-8f30-6580b1d54bf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.168042 Jan 27 16:03:50.549758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 100/213] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:50 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:50.553870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:50.554501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:50.560818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.561263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.562032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.562460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.588228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:50.588763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:50.594672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.595159 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.595951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.596390 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.692925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:50.700344 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fba8ece1-d868-427b-8fff-403e9ff93362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.151335 Jan 27 16:03:50.700934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 114/214] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:50 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:50.732955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:50.740073 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c90a285e-5d0b-4327-ad0a-8bb2d9d228d5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.156042 Jan 27 16:03:50.740633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 101/215] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:50 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:50.765115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:50.765708 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:50.772181 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.772616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.773385 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:50.773818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:50.901476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:50.908673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-86ed555e-9c44-4431-b9da-edcb9ac0fb62 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.147192 Jan 27 16:03:50.909236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 115/216] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:50 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:51.129174 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:51.129697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:51.135711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.136170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.136950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.137382 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.265054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:51.273546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-be41980d-a74d-402d-adcd-aadb3b18276c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.148051 Jan 27 16:03:51.274152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 102/217] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:51 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:51.567799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:51.568348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:51.574193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.574628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.575420 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.575844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.702099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:51.709866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:51.711388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:51.712480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f36326ad-e1f0-4bfd-ad73-3a5bdc154adb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.149043 Jan 27 16:03:51.713037 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 116/218] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:51 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:51.717529 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:51.718139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:51.724063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.724508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.725287 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.725722 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.756926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:51.757524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:51.763512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.763994 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.764767 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.765196 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.862011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:51.869836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c6e9072e-84a2-4f35-8298-d9f50883b362 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.155953 Jan 27 16:03:51.870412 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 103/219] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:51 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:51.891681 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:51.898754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-809766ee-8469-4e8b-a147-c0e6b740c9e7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.146080 Jan 27 16:03:51.899339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 117/220] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:51 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:51.925557 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:51.926157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:51.931937 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.932383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:51.933158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:51.933579 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.071725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:52.079317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1d7452b7-07e5-4fd0-82df-cec609a2f6e8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.157796 Jan 27 16:03:52.079879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 104/221] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:51 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:52.290682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:52.291315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:52.297254 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.297705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.298479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.298913 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.442634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:52.449779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-98d16c4b-d820-41e4-9f16-81e31f6f9a95 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.162754 Jan 27 16:03:52.450348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 118/222] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:52 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:52.730328 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:52.730927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:52.736876 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.737323 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.738107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.738539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.867633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:52.875506 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:52.877011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:52.878609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1eca3a60-6937-44d1-a9ce-74e94b61749b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.151538 Jan 27 16:03:52.879191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 105/223] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:52 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:52.886880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:52.887594 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:52.894149 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.894672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.895554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.895989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.914872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:52.915513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:52.921271 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.921723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:52.922502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:52.922938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:53.032306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:53.040045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-673a1df2-f9b1-4215-9eb6-14cdc6644710 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.156284 Jan 27 16:03:53.040807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 119/224] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:52 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:53.064837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:53.072733 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c04c01fe-88a1-40b5-a6d5-202ae29dcd9b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.161431 Jan 27 16:03:53.073286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 106/225] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:52 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:53.095990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:53.096707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:53.103106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:53.103602 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:53.104441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:53.104906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:53.236867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:53.244428 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-632b566a-761f-4995-908c-a97f74bde60a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.152240 Jan 27 16:03:53.244995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 120/226] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:53 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:53.467012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:53.467624 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:53.474476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:53.474930 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:53.475734 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:53.476174 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:53.607384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:53.616016 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8d350c7d-1cdb-416b-b5ca-1a8a7dda4aab tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.152611 Jan 27 16:03:53.616491 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 107/227] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:53 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:53.897027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:53.897560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:53.903500 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:53.903953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:53.904727 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:53.905160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.029248 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:54.037662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:54.039201 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:54.040285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d88949f8-26e4-492f-965d-ac5c3a1142f3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.147578 Jan 27 16:03:54.040852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 121/228] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:53 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:54.057110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:54.057719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:54.064973 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.065462 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.066256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.066691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.089348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:54.089962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:54.095776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.096222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.097652 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.098185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.231694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:54.238844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-47c6df3d-1702-4b66-927e-31ee4e2f1cde tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.185709 Jan 27 16:03:54.239436 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 108/229] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:54 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:54.256471 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:54.261111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:54.261709 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:54.264315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7fe1f96f-3e4a-4af4-a7d3-ba664b84e520 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.178668 Jan 27 16:03:54.264890 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 122/230] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:54 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:54.267386 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.267831 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.269203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.269633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.393206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:54.400972 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3fc692ac-d722-403b-80c6-e066bd6757d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.143371 Jan 27 16:03:54.401535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 109/231] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:54 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:54.633858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:54.634460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:54.640351 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.640796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.641600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:54.642036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:54.772706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:54.780008 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0bc250c6-701c-42da-af00-b13afb18ebb2 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.149808 Jan 27 16:03:54.780580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 123/232] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:54 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:55.058039 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:55.058647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:55.064891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.065898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.066740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.067208 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.202757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:55.211323 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:55.212749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:55.213842 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c326aabf-c97c-4678-be91-3ca74b4a0eb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.159663 Jan 27 16:03:55.214393 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 110/233] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:55 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:55.256588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:55.257398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:55.264806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.265383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.266322 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.266894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.281095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:55.281911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:55.287769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.288265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.289071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.289520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.424178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:55.433852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eaae7586-9574-417a-8d3b-51ad09284651 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.181885 Jan 27 16:03:55.434444 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 124/234] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:55 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:55.444971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:55.445954 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:55.453662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.454146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.455064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.455636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.614996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:55.627114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:55.629657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-039f952c-71ed-4c04-9736-d8e3cd23274e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.188314 Jan 27 16:03:55.630575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 125/235] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:55 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:55.635376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0070863e-9a1f-4798-bae5-746f2e7b7300 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.357771 Jan 27 16:03:55.636032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 111/236] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:55 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:55.796522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:55.797151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:55.804751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.805194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.805984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:55.806416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:55.934673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:55.941830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dd6e1f8c-17bc-4ac7-823b-a0f3f16ed462 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.149024 Jan 27 16:03:55.942399 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 126/237] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:55 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:56.233611 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:56.234286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:56.241098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.241538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.242330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.242756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.368521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:56.376427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:56.378681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:56.379795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8738fcd2-0774-4bfb-9c4f-a64f3768284d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.150013 Jan 27 16:03:56.380345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 112/238] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:56 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:56.453302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:56.454044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:56.459855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.460310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.461097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.461532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.603594 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:56.611493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-72e8f6e5-4cb8-4cf2-9aff-001fc1369bd6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.161735 Jan 27 16:03:56.612624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 127/239] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:56 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:56.646404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:56.647318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:56.651907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:56.652623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:56.653902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.654537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.655363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.655799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.658579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.659561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.660352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.660788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.802169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:56.810317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3bac40a5-039f-4993-9144-a9456e973676 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.161834 Jan 27 16:03:56.811024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 128/240] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:56 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:56.812272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:56.819544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dfb8afff-f7f3-4003-885e-ffac6f111f11 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.176739 Jan 27 16:03:56.820092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 113/241] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:56 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:56.958152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:56.958759 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:56.964755 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.965205 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:56.965981 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:56.966415 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.098772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:57.107479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a4c46e3a-48a4-4148-b68c-b4cca9fd5183 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.153416 Jan 27 16:03:57.108113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 129/242] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:56 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:57.398443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:57.399034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:57.404939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.405377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.406148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.406572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.545841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:57.555299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:57.556780 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:57.557853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c5a86642-20c2-42ee-bd53-afd5887e22b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.163238 Jan 27 16:03:57.558405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 114/243] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:57 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:57.628644 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:57.629409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:57.636395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.636716 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.637511 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.638275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.827847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:57.828405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:57.835438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.835888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.836687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.837120 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.953485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:57.961723 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e71c3019-2358-492a-a3f5-eae88187274e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.336673 Jan 27 16:03:57.962303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 130/244] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:57 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:57.966571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:57.967199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:57.974101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.974546 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:57.975896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:57.975896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:58.000611 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:58.008417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ffb2b33e-a426-4868-8d2b-c151b3fdf27d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.184551 Jan 27 16:03:58.008993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 115/245] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:57 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:58.113927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:58.121270 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a99c7277-bdea-4087-afb2-4e0b9d1983c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.157992 Jan 27 16:03:58.122004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 131/246] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:57 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:58.125814 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:58.126417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:58.133003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:58.133450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:58.134235 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:58.134670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:58.260252 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:58.267385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c5f2a509-1197-46a1-82f1-ffc3981e408e tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.145713 Jan 27 16:03:58.267954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 116/247] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:58 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:58.575435 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:58.575958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:58.582005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:58.582484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:58.583321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:58.583762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:58.716307 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:58.724433 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:58.725936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:58.727037 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bfcdf4d3-a16a-4224-9e96-70896aea755e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.155394 Jan 27 16:03:58.727587 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 132/248] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:58 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:03:58.978684 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:58.979448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:58.985872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:58.986318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:58.987672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:58.988104 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.031265 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:59.031862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:59.038359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.039277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.039914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.040359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.117723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:59.128238 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-da238ff5-2dc7-4e7c-b14c-2817ebcc3df2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.153351 Jan 27 16:03:59.128829 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 117/249] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:58 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:03:59.138539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:59.139322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:59.145993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.146440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.147253 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.147686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.177655 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:59.185097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5ebc0d8d-7bce-414a-9033-748d729a930a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.157400 Jan 27 16:03:59.185848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 133/250] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:59 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:59.285225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:59.285868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:59.291939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.292388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.294084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:59.294220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.294220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.300391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c4b9c835-9e0a-479c-88f4-8bc7369f4afd tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.165574 Jan 27 16:03:59.300990 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 118/251] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:59 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:59.427425 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:59.435020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8fcaa23f-eb85-4b19-8f59-da96543743c4 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.154213 Jan 27 16:03:59.435608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 134/252] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:03:59 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:03:59.745251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:03:59.745847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:03:59.752011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.755151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.755151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:03:59.755151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:03:59.881377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:59.888982 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:59.890476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:03:59.891586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-37330ef4-d37d-4251-97e6-14099a70ba94 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.149977 Jan 27 16:03:59.892135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 119/253] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:03:59 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:00.145141 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:00.145775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:00.152025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.152477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.153282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.153719 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.201401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:00.202012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:00.207802 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.208242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.209007 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.209437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.292520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:00.302472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-53cf531d-f05d-43fc-95bf-4259414a9d49 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.161096 Jan 27 16:04:00.303656 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 135/254] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:00 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:00.316705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:00.317570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:00.324484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.324943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.325734 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.326167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.345276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:00.353227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f16183f8-1f1e-44e5-af9f-143e759383c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1318 microversion: 2.1 time: 0.155436 Jan 27 16:04:00.353897 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 120/255] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:00 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:00.460517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:00.466118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:00.475480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:00.477117 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.480966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.481833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.482279 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.482883 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f32ecf99-8d12-4e74-b4c0-bd7b039955c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.169878 Jan 27 16:04:00.483877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 136/256] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:00 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:00.638053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:00.645746 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-657b4b5f-5227-491f-a116-a9cee0e32de1 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1315 microversion: 2.1 time: 0.197411 Jan 27 16:04:00.646329 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 121/257] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:00 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:00.910323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:00.910935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:00.916928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.917379 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:00.918158 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:00.918591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.048845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:01.056581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:01.058073 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:01.059197 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-04c11c3a-7d1a-4a4a-b215-c331a36d330d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.153331 Jan 27 16:04:01.059757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 137/258] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:00 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:01.319425 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:01.320030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:01.325899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.326384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.327239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.327671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.370350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:01.371170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:01.378491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.378935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.379764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.380199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.466675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:01.474595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d2f27ed9-5ac7-4866-9bf9-25bb8e28d6dc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.158616 Jan 27 16:04:01.475208 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 122/259] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:01 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:01.500640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:01.501464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:01.509913 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.510364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.511593 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.512505 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.528615 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:01.537524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a7bf8849-2a1b-4c9b-9a2e-cab77b035d82 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1508 microversion: 2.1 time: 0.170668 Jan 27 16:04:01.538239 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 138/260] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:01 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:01.655759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:01.662418 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:01.663182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:01.663717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a4851d35-420c-4689-b449-9fd3ac0a912c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.166746 Jan 27 16:04:01.664668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 123/261] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:01 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:01.672961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.673494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.674945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:01.675550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:01.856306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:01.873505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7286a2db-8e02-473a-9527-f49f4a3003eb tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1501 microversion: 2.1 time: 0.214399 Jan 27 16:04:01.874798 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 139/262] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:01 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1501 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:02.077998 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:02.079321 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:02.087051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.087506 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.088297 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.088734 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.270763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:02.279751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:02.281254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:02.282605 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3b0252d6-751e-4c61-a7a7-2343a200da67 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.208499 Jan 27 16:04:02.283278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 124/263] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:02 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:02.496458 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:02.496960 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:02.504054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.504544 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.505328 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.505794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.647255 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:02.655152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0e6abc14-0c67-4427-bd71-0086429f18f9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.162720 Jan 27 16:04:02.657252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 140/264] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:02 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:02.681543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:02.682904 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:02.691443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.692198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.693483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.694214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.831948 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:02.839102 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f52124c3-b505-4cc7-875c-c87dd9248aef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.161862 Jan 27 16:04:02.839843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 125/265] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:02 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:02.919453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dd370acd-ae1f-40ef-94b4-1c7c6f9c2ac4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b82e1b36-35cd-4051-a4db-54334f168f37"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:02.920560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dd370acd-ae1f-40ef-94b4-1c7c6f9c2ac4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:02.927158 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd370acd-ae1f-40ef-94b4-1c7c6f9c2ac4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.927607 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd370acd-ae1f-40ef-94b4-1c7c6f9c2ac4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.928389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd370acd-ae1f-40ef-94b4-1c7c6f9c2ac4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.928823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd370acd-ae1f-40ef-94b4-1c7c6f9c2ac4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:02.979432 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-6bea8572-7c12-4dc4-824a-f8511cce3abc req-508a75a4-5146-4801-ae60-9110b3b8104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3d80d1-f3b7-4435-853e-6c267367f0f9", "name": "network-vif-plugged", "status": "completed", "tag": "d2fdd9de-12ca-4356-8752-d36ccf10679b"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:02.981269 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:04:02.981269 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:04:02.989543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-6bea8572-7c12-4dc4-824a-f8511cce3abc req-508a75a4-5146-4801-ae60-9110b3b8104d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:02.990223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-6bea8572-7c12-4dc4-824a-f8511cce3abc req-508a75a4-5146-4801-ae60-9110b3b8104d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:03.006924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-6bea8572-7c12-4dc4-824a-f8511cce3abc req-508a75a4-5146-4801-ae60-9110b3b8104d service nova] Creating event network-vif-plugged:d2fdd9de-12ca-4356-8752-d36ccf10679b for instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 on hv-cinder-82635 Jan 27 16:04:03.013362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-6bea8572-7c12-4dc4-824a-f8511cce3abc req-508a75a4-5146-4801-ae60-9110b3b8104d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038646 Jan 27 16:04:03.014030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 126/266] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:03.302195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:03.302908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:03.308828 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:03.309267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:03.310340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:03.310774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:03.438491 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:03.446142 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:03.447667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:03.448748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-aae9d35a-e12d-4778-8eea-5a3f51fb16a1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.151402 Jan 27 16:04:03.449297 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 127/267] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:03 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:04:03.671219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:03.671824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:03.677664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:03.678115 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:03.678888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:03.679346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:03.807402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:03.814617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c4354bc1-ad03-4ada-97a8-5d60e8086ae4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.147036 Jan 27 16:04:03.815938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 128/268] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:03 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:03.855808 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:03.856408 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:03.862654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:03.863126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:03.863900 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:03.864337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:03.991421 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:03.998622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6b14d15d-e7b9-42b0-8cec-b895a116164e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.146317 Jan 27 16:04:03.999482 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 129/269] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:03 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:04.466585 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:04.467151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:04.473580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:04.474027 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:04.474801 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:04.475261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:04.600269 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:04.608041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:04.609531 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:04.610608 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-543ca6a1-eccc-4f52-8617-f32560aedc4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.147732 Jan 27 16:04:04.611178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 130/270] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:04 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:04:04.831787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:04.832421 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:04.838215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:04.838664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:04.839463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:04.839905 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:04.970262 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:04.978155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-00bc9010-2ea8-4f75-864f-9ec92ac12312 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.150114 Jan 27 16:04:04.978730 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 131/271] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:04 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:05.014528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:05.015155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:05.021087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:05.021527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:05.022303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:05.022728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:05.152304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:05.160128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9b848d6c-ba4e-436d-a040-aa9d4c4e58e5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.149173 Jan 27 16:04:05.160692 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 132/272] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:05 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:05.165000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-7e2ba49f-4c95-417f-9f41-fde81315ecdd req-16fcde99-f86c-4402-bd22-5cd14cbd281e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c1dfef-ceda-489a-a7ea-045b8ab0f249", "name": "network-vif-plugged", "status": "completed", "tag": "02126963-aa69-4146-be3b-fb8b3197466e"}, {"server_uuid": "e56702b3-830c-441b-b790-b13f42d20c0d", "name": "network-vif-plugged", "status": "completed", "tag": "fdc1784f-018f-4bdb-9f4c-28700d25817c"}, {"server_uuid": "ffb168b3-a714-4f0b-aca9-d23922390178", "name": "network-vif-plugged", "status": "completed", "tag": "7f3911ec-edec-4658-b029-6a522d1a3093"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:05.166835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:04:05.166835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:04:05.174919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-7e2ba49f-4c95-417f-9f41-fde81315ecdd req-16fcde99-f86c-4402-bd22-5cd14cbd281e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:05.175390 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-7e2ba49f-4c95-417f-9f41-fde81315ecdd req-16fcde99-f86c-4402-bd22-5cd14cbd281e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:05.188515 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-7e2ba49f-4c95-417f-9f41-fde81315ecdd req-16fcde99-f86c-4402-bd22-5cd14cbd281e service nova] Creating event network-vif-plugged:02126963-aa69-4146-be3b-fb8b3197466e for instance 53c1dfef-ceda-489a-a7ea-045b8ab0f249 on hv-cinder-82635 Jan 27 16:04:05.189041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-7e2ba49f-4c95-417f-9f41-fde81315ecdd req-16fcde99-f86c-4402-bd22-5cd14cbd281e service nova] Creating event network-vif-plugged:fdc1784f-018f-4bdb-9f4c-28700d25817c for instance e56702b3-830c-441b-b790-b13f42d20c0d on hv-cinder-82635 Jan 27 16:04:05.189535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-7e2ba49f-4c95-417f-9f41-fde81315ecdd req-16fcde99-f86c-4402-bd22-5cd14cbd281e service nova] Creating event network-vif-plugged:7f3911ec-edec-4658-b029-6a522d1a3093 for instance ffb168b3-a714-4f0b-aca9-d23922390178 on hv-cinder-82635 Jan 27 16:04:05.197345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-7e2ba49f-4c95-417f-9f41-fde81315ecdd req-16fcde99-f86c-4402-bd22-5cd14cbd281e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035515 Jan 27 16:04:05.197923 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 133/273] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:04:05.630105 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:05.630681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:05.636775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:05.637215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:05.637983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:05.638410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:05.782487 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:05.790377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:05.791911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:05.793008 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e6bd8119-ee40-4bf7-b255-5cfab5b236bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.167611 Jan 27 16:04:05.793564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 134/274] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:05 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:04:05.994967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:05.995630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:06.001699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:06.002707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:06.003516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:06.003961 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:06.137257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:06.145036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3259340f-63e6-4b8a-81c5-91ef23674579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.153683 Jan 27 16:04:06.145630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 135/275] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:05 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:06.176070 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:06.176669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:06.182261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:06.182708 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:06.183539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:06.183956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:06.312926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:06.320581 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bb5fc77b-8cbe-407d-8202-26205ad56a32 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.147917 Jan 27 16:04:06.321139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 136/276] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:06 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:06.810484 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:06.811201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:06.817748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:06.818190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:06.818965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:06.819416 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:06.958719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:06.967046 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:06.968558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:06.969675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9c774086-4bc8-4602-9268-1c5a3ad50728 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.162818 Jan 27 16:04:06.970232 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 137/277] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:06 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:04:07.163206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:07.163882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:07.169711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:07.170156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:07.170924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:07.171384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:07.333814 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:07.344700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3d19f32e-48ca-4870-bcf2-9bd10b037008 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.186287 Jan 27 16:04:07.353978 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 138/278] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:07 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:07.368087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:07.368743 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:07.380188 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:07.380188 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:07.384010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:07.384459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:07.576176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dd370acd-ae1f-40ef-94b4-1c7c6f9c2ac4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.660362 Jan 27 16:04:07.577770 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 141/279] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:04:02 2022] POST /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments => generated 194 bytes in 4663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:07.681069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:07.688779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b77c66b0-6ca2-4723-bf51-0ed67f3b35a6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.333672 Jan 27 16:04:07.689345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 139/280] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:07 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:07.988661 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:07.989915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:07.996547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:07.997000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:07.997796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:07.998232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:08.262762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:08.273664 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:08.275217 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:08.276323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e423b95c-a1f6-4c85-b430-8bbb02c042ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.291828 Jan 27 16:04:08.276869 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 142/281] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:07 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:08.363114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:08.364275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:08.370010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:08.370462 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:08.371278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:08.371715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:08.519871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:08.531680 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cc02f5ff-45c9-44c7-aeda-86656aa2b984 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.172366 Jan 27 16:04:08.532560 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 140/282] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:08 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:08.705894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:08.706500 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:08.712601 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:08.713046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:08.713830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:08.714263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:08.845753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:08.853557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-daa49af4-fcd6-43ec-8d8a-912bcb528f07 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.151895 Jan 27 16:04:08.854124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 143/283] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:08 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:09.294633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:09.295264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:09.302247 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.302633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:09.303450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.303884 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:09.435061 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:09.442652 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:09.444166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:09.445244 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-109d7db5-9949-40e3-bc48-1d27e9fec370 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.154271 Jan 27 16:04:09.445791 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 141/284] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:09 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:09.550004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:09.550605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:09.556642 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.557095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:09.557887 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.559652 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:09.600467 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1eb4f5a9-082b-4bc7-a003-cdf084eaa85c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73ed4e8f-a6a9-4027-b4bb-fa093791dd96"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:09.601586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1eb4f5a9-082b-4bc7-a003-cdf084eaa85c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:09.607458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eb4f5a9-082b-4bc7-a003-cdf084eaa85c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.607898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eb4f5a9-082b-4bc7-a003-cdf084eaa85c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:09.608717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eb4f5a9-082b-4bc7-a003-cdf084eaa85c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.609095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1eb4f5a9-082b-4bc7-a003-cdf084eaa85c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:09.690154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:09.697706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4a8b9a95-cd94-4f22-8b35-d5d6118ff9f8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.151974 Jan 27 16:04:09.698267 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 144/285] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:09 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:09.870780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:09.871451 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:09.877981 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.878426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:09.879230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:09.879669 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:10.007599 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:10.014681 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-10b8546b-ca5a-4b61-8ef4-663779872cf8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.147563 Jan 27 16:04:10.015275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 145/286] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:09 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:10.463049 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:10.463576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:10.469438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:10.469881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:10.470705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:10.471166 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:10.600888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:10.608776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:10.610260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:10.611985 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6a3e8252-7608-42d0-834b-b5419ba846cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.152156 Jan 27 16:04:10.612541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 146/287] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:10 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:04:10.714356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:10.714867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:10.721235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:10.721676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:10.722441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:10.722873 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:10.856764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:10.864668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d0b2eece-e09c-4500-9c72-81907c825b06 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.154015 Jan 27 16:04:10.865231 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 147/288] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:10 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:11.031855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:11.033785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:11.040567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:11.041087 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:11.041963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:11.042476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:11.192655 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:11.199889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9c3abfca-e9a5-4c71-921e-94d0d1b25758 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.171730 Jan 27 16:04:11.200624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 148/289] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:11 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:11.266905 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1eb4f5a9-082b-4bc7-a003-cdf084eaa85c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "POST /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.669971 Jan 27 16:04:11.268043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 142/290] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:04:09 2022] POST /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4/os-volume_attachments => generated 194 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:11.629704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:11.630342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:11.636227 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:11.636675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:11.637454 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:11.637889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:11.772623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:11.780260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:11.781756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:11.782836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9a0c6c81-87d9-42d5-acd3-5e93f785aee0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.156897 Jan 27 16:04:11.783962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 149/291] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:11 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:11.881624 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:11.882303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:12.021395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:12.021833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:12.022640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:12.023092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:12.161936 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:12.169177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9bcc22f0-6980-4b2d-b5d4-2d03cadb44c8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.291480 Jan 27 16:04:12.169741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 143/292] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:11 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:12.216267 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:12.216872 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:12.223631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:12.224084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:12.224913 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:12.225350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:12.364511 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:12.373871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8f59c249-3f58-4189-accd-f6145efe690b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.160545 Jan 27 16:04:12.375186 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 150/293] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:12 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:12.800880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:12.801536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:12.807878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:12.808330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:12.809116 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:12.809563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:12.938378 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:12.946619 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:12.948154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:12.949241 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-08053fe6-6e01-47a0-9120-0c281f9882e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.152606 Jan 27 16:04:12.949796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 144/294] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:12 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:13.185356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:13.185965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:13.192495 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:13.192951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:13.193736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:13.194173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:13.320994 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:13.328631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5234d57f-d8c1-499f-91d7-a4ecccaa27f7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.146846 Jan 27 16:04:13.329225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 151/295] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:13 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:13.394344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:13.394950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:13.401219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:13.401669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:13.402450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:13.402885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:13.529955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:13.540803 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b69062e0-7323-4911-98b0-51e1ad96dfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.150018 Jan 27 16:04:13.541362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 145/296] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:13 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:13.966271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:13.967515 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:13.972680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:13.973125 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:13.973889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:13.974316 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:14.112578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:14.120228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:14.121724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:14.122800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8a6f635d-196e-4cb2-ab95-f8a74844da54 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.160420 Jan 27 16:04:14.123384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 152/297] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:13 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:14.345302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:14.345913 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:14.351767 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:14.352218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:14.352995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:14.353428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:14.493668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:14.501111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-12a8c867-2409-4942-b036-39e1e11b8847 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.159393 Jan 27 16:04:14.501722 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 146/298] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:14 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:14.557699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:14.558315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:14.564923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:14.565393 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:14.566176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:14.566605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:14.708852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:14.716576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0daba321-8f34-4f13-9a13-e5ece4b61a0d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.162436 Jan 27 16:04:14.717235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 153/299] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:14 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:15.141636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:15.142240 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:15.148408 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:15.148853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:15.149653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:15.150115 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:15.274489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:15.288228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:15.289733 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:15.291004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3b1ffe53-a266-4cf5-a545-f7fcdb6c7b8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.153089 Jan 27 16:04:15.291783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 147/300] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:15 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:15.517617 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:15.518238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:15.528265 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:15.529076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:15.530501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:15.531313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:15.663424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:15.670426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2bc9e227-22a9-46cb-9e2e-5652bc6a5064 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.156561 Jan 27 16:04:15.671011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 154/301] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:15 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:15.733651 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:15.734254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:15.741491 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:15.741871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:15.742666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:15.743138 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:15.874910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:15.882000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5b9b2db6-690a-4f6f-b670-04492ded9002 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.151968 Jan 27 16:04:15.882545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 148/302] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:15 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:16.310925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:16.311486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:16.320653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:16.321102 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:16.322332 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:16.323111 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:16.460667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:16.468342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:16.469843 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:16.470988 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e168f66e-46a2-45ca-8673-2754925e314c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1407 microversion: 2.20 time: 0.165366 Jan 27 16:04:16.471564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 155/303] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:16 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:16.688965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:16.690839 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:16.696131 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:16.696576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:16.697355 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:16.697838 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:16.865833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:16.873265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-746fb31c-6944-4225-9812-4e0103ff1bd8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1322 microversion: 2.1 time: 0.189713 Jan 27 16:04:16.874084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 149/304] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:16 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:16.899097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:16.899715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:16.906654 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:16.907144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:16.908489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:16.908927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:17.062147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:17.074641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a04f551e-d762-4b36-a5b8-a4ddf2e48a29 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1363 microversion: 2.1 time: 0.179716 Jan 27 16:04:17.075559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 156/305] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:16 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:17.489606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:17.490213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:17.496278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:17.496728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:17.497512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:17.497953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:17.661782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:17.677498 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:17.680390 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:17.682248 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b81e183e-f939-4ac1-ae63-31fc850feec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1598 microversion: 2.20 time: 0.196357 Jan 27 16:04:17.684780 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 150/306] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:04:17 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1598 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:17.702682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3a042b18-97c2-4a6a-b526-9927ba62f552 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:17.703213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3a042b18-97c2-4a6a-b526-9927ba62f552 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:17.710335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a042b18-97c2-4a6a-b526-9927ba62f552 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:17.710726 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a042b18-97c2-4a6a-b526-9927ba62f552 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:17.711611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a042b18-97c2-4a6a-b526-9927ba62f552 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:17.712038 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a042b18-97c2-4a6a-b526-9927ba62f552 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:17.817237 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3a042b18-97c2-4a6a-b526-9927ba62f552 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118119 Jan 27 16:04:17.818129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 157/307] 10.222.0.61 () {60 vars in 1315 bytes} [Thu Jan 27 16:04:17 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:17.889343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:17.889942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:17.897915 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:17.898339 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:17.899207 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:17.899600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.073175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:18.083594 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-edbb14c2-e8a8-4fb1-9c83-e759e510b50b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1516 microversion: 2.1 time: 0.196939 Jan 27 16:04:18.084916 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 151/308] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:17 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:18.092588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:18.093191 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:18.102282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.103098 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.104852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.105840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.107839 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:18.109010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:18.119976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.120622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.121715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.122303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.155398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lazy-loading 'flavor' on Instance uuid 53c1dfef-ceda-489a-a7ea-045b8ab0f249 {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:04:18.306279 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6d87b401-2a99-467c-b575-af20a6958e2b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249/action" status: 200 len: 32 microversion: 2.1 time: 0.206962 Jan 27 16:04:18.307507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 152/309] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:18 2022] POST /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:18.316990 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:18.317376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:18.335819 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.337967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.339479 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.340155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.580816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:18.589098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-47ac4fc8-0cf8-4f13-82eb-0e76e88e3c73 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.276558 Jan 27 16:04:18.590103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 153/310] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:18 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:18.779766 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:18.797421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cd1fd3a6-f02c-49ee-a879-f96b6b48b88f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1548 microversion: 2.1 time: 0.709126 Jan 27 16:04:18.799731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 158/311] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:18 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1548 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:18.816482 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-45995121-46e1-4220-a9f6-2431b2051e3a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:18.816973 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-45995121-46e1-4220-a9f6-2431b2051e3a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:18.835761 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45995121-46e1-4220-a9f6-2431b2051e3a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.837087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45995121-46e1-4220-a9f6-2431b2051e3a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.838275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45995121-46e1-4220-a9f6-2431b2051e3a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:18.839182 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45995121-46e1-4220-a9f6-2431b2051e3a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:18.965485 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-45995121-46e1-4220-a9f6-2431b2051e3a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153103 Jan 27 16:04:18.966302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 154/312] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jan 27 16:04:18 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:04:19.607101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:19.607712 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:19.615834 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:19.616677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:19.617717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:19.618268 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:19.946496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:20.015274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-459860d6-a1f8-4ff8-b300-a51edb3cb790 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.411978 Jan 27 16:04:20.016150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 159/313] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:19 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:20.099458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0c7f0b66-5265-4b2d-b64a-e8cd7e1e050f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:20.100523 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0c7f0b66-5265-4b2d-b64a-e8cd7e1e050f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:20.101385 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-2a391408-dec3-4474-904e-647699303b63 req-af066e2a-21cf-47f1-bdc1-67c8364e3fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb168b3-a714-4f0b-aca9-d23922390178", "tag": "7f3911ec-edec-4658-b029-6a522d1a3093"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:20.103262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:04:20.103262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:04:20.112184 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2a391408-dec3-4474-904e-647699303b63 req-af066e2a-21cf-47f1-bdc1-67c8364e3fc9 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:20.112877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2a391408-dec3-4474-904e-647699303b63 req-af066e2a-21cf-47f1-bdc1-67c8364e3fc9 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:20.114002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c7f0b66-5265-4b2d-b64a-e8cd7e1e050f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:20.116079 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c7f0b66-5265-4b2d-b64a-e8cd7e1e050f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:20.119043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c7f0b66-5265-4b2d-b64a-e8cd7e1e050f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:20.119567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0c7f0b66-5265-4b2d-b64a-e8cd7e1e050f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:20.131939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-2a391408-dec3-4474-904e-647699303b63 req-af066e2a-21cf-47f1-bdc1-67c8364e3fc9 service nova] Creating event network-changed:7f3911ec-edec-4658-b029-6a522d1a3093 for instance ffb168b3-a714-4f0b-aca9-d23922390178 on hv-cinder-82635 Jan 27 16:04:20.139202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-2a391408-dec3-4474-904e-647699303b63 req-af066e2a-21cf-47f1-bdc1-67c8364e3fc9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041443 Jan 27 16:04:20.144961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 160/314] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:20.238066 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0c7f0b66-5265-4b2d-b64a-e8cd7e1e050f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 0.142044 Jan 27 16:04:20.243946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 155/315] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:20 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:20.931609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-611dd016-6084-4a06-b69f-e75c618fb0b4 req-b8f454ab-6277-4b29-9613-f9242a475283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3d80d1-f3b7-4435-853e-6c267367f0f9", "tag": "d2fdd9de-12ca-4356-8752-d36ccf10679b"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:20.933203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:04:20.933203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:04:20.938057 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4acdefcf-f48d-4f80-8e31-75ac8e2de064 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:20.939752 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4acdefcf-f48d-4f80-8e31-75ac8e2de064 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:20.955408 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4acdefcf-f48d-4f80-8e31-75ac8e2de064 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:20.955867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4acdefcf-f48d-4f80-8e31-75ac8e2de064 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:20.956694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4acdefcf-f48d-4f80-8e31-75ac8e2de064 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:20.957134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4acdefcf-f48d-4f80-8e31-75ac8e2de064 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:20.962729 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-611dd016-6084-4a06-b69f-e75c618fb0b4 req-b8f454ab-6277-4b29-9613-f9242a475283 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:20.966771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-611dd016-6084-4a06-b69f-e75c618fb0b4 req-b8f454ab-6277-4b29-9613-f9242a475283 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:20.993000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-611dd016-6084-4a06-b69f-e75c618fb0b4 req-b8f454ab-6277-4b29-9613-f9242a475283 service nova] Creating event network-changed:d2fdd9de-12ca-4356-8752-d36ccf10679b for instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 on hv-cinder-82635 Jan 27 16:04:21.005602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-611dd016-6084-4a06-b69f-e75c618fb0b4 req-b8f454ab-6277-4b29-9613-f9242a475283 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077303 Jan 27 16:04:21.006552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 156/316] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:21.033903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:21.034764 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:21.050558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:21.051116 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:21.052067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:21.052670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:21.066931 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4acdefcf-f48d-4f80-8e31-75ac8e2de064 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.142107 Jan 27 16:04:21.070776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 161/317] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:20 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:21.258679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-04a27f7e-5d01-4525-a965-e3eaaced4a9d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:21.268999 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-04a27f7e-5d01-4525-a965-e3eaaced4a9d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:21.285363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a27f7e-5d01-4525-a965-e3eaaced4a9d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:21.286153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a27f7e-5d01-4525-a965-e3eaaced4a9d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:21.287506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a27f7e-5d01-4525-a965-e3eaaced4a9d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:21.287735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:21.289278 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a27f7e-5d01-4525-a965-e3eaaced4a9d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:21.320057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cf08ba99-7b1a-4b3e-b96d-fa2e0664d5a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.290510 Jan 27 16:04:21.321213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 157/318] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:21 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:21.433419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-04a27f7e-5d01-4525-a965-e3eaaced4a9d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 0.185404 Jan 27 16:04:21.434757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 162/319] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:21 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:22.080831 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1c3f5068-79fe-4021-bae5-2329b30b3a26 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:22.083009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1c3f5068-79fe-4021-bae5-2329b30b3a26 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:22.091031 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c3f5068-79fe-4021-bae5-2329b30b3a26 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:22.093026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c3f5068-79fe-4021-bae5-2329b30b3a26 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:22.094051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c3f5068-79fe-4021-bae5-2329b30b3a26 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:22.094714 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c3f5068-79fe-4021-bae5-2329b30b3a26 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:22.344095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:22.346134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:22.356363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:22.356926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:22.357909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:22.358614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:22.536562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:22.543991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-55167e33-d987-4805-b682-84ee2d7bcb74 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.204917 Jan 27 16:04:22.544567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 163/320] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:22 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:22.549527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8fc2d0ab-c7dc-45f9-8d02-4dc5f05b1e89 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:22.550448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8fc2d0ab-c7dc-45f9-8d02-4dc5f05b1e89 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:22.557165 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fc2d0ab-c7dc-45f9-8d02-4dc5f05b1e89 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:22.557896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fc2d0ab-c7dc-45f9-8d02-4dc5f05b1e89 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:22.558777 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fc2d0ab-c7dc-45f9-8d02-4dc5f05b1e89 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:22.559181 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8fc2d0ab-c7dc-45f9-8d02-4dc5f05b1e89 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:25.909621 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1c3f5068-79fe-4021-bae5-2329b30b3a26 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 14 microversion: 2.1 time: 3.832953 Jan 27 16:04:25.910208 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 158/321] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:22 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 14 bytes in 3835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:25.915320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:25.916019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:25.923556 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:25.924045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:25.925256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:25.925500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:25.951235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8fc2d0ab-c7dc-45f9-8d02-4dc5f05b1e89 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 3.404915 Jan 27 16:04:25.952625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 164/322] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:22 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 3407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:26.069772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:26.079697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b6a4820b-6b3d-4abe-a6d2-c4ddd36074fb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.167703 Jan 27 16:04:26.080250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 159/323] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:25 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:26.920298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-38260510-5df6-40d3-9b5c-2cb9c1c934db tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:26.921341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-38260510-5df6-40d3-9b5c-2cb9c1c934db tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:26.930661 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-38260510-5df6-40d3-9b5c-2cb9c1c934db tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:26.931133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-38260510-5df6-40d3-9b5c-2cb9c1c934db tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:26.931907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-38260510-5df6-40d3-9b5c-2cb9c1c934db tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:26.932336 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-38260510-5df6-40d3-9b5c-2cb9c1c934db tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:26.963870 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0f39b48d-e950-4e8c-ba4a-cea9a3dc171b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:26.964787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0f39b48d-e950-4e8c-ba4a-cea9a3dc171b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:26.972099 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f39b48d-e950-4e8c-ba4a-cea9a3dc171b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:26.972550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f39b48d-e950-4e8c-ba4a-cea9a3dc171b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:26.973365 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f39b48d-e950-4e8c-ba4a-cea9a3dc171b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:26.973804 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f39b48d-e950-4e8c-ba4a-cea9a3dc171b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:31.170540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-38260510-5df6-40d3-9b5c-2cb9c1c934db tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 14 microversion: 2.1 time: 4.253975 Jan 27 16:04:31.171209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 165/324] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:26 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 14 bytes in 4256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:31.177119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:31.177119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:31.184984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:31.185428 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:31.186292 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:31.186729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:31.215968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0f39b48d-e950-4e8c-ba4a-cea9a3dc171b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 4.255318 Jan 27 16:04:31.219191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 160/325] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:26 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 4257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:31.324911 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:31.333783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d97d3a5a-acbe-4c14-899b-9ff252f0fd0e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.160640 Jan 27 16:04:31.333783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 166/326] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:31 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:32.181176 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e5682f30-e7a1-4998-8e98-75b1478a24cb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:32.182259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e5682f30-e7a1-4998-8e98-75b1478a24cb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:32.190643 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e5682f30-e7a1-4998-8e98-75b1478a24cb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:32.191110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e5682f30-e7a1-4998-8e98-75b1478a24cb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:32.191897 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e5682f30-e7a1-4998-8e98-75b1478a24cb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:32.192356 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e5682f30-e7a1-4998-8e98-75b1478a24cb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:32.226815 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-42c36aca-a6e9-4e3b-9156-80191c84f53d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:32.227763 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-42c36aca-a6e9-4e3b-9156-80191c84f53d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:32.233979 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42c36aca-a6e9-4e3b-9156-80191c84f53d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:32.234425 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42c36aca-a6e9-4e3b-9156-80191c84f53d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:32.235394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42c36aca-a6e9-4e3b-9156-80191c84f53d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:32.235824 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42c36aca-a6e9-4e3b-9156-80191c84f53d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:32.363519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-42c36aca-a6e9-4e3b-9156-80191c84f53d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 0.140234 Jan 27 16:04:32.366875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 167/327] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:32 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:32.368989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:32.369709 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:32.372728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e5682f30-e7a1-4998-8e98-75b1478a24cb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.192706 Jan 27 16:04:32.372728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 161/328] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:32 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:32.379855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:32.380308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:32.381114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:32.381552 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:32.537532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:32.548341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-41c266c5-9936-44c7-87d1-5cca40cdfba1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.183015 Jan 27 16:04:32.549002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 168/329] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:32 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:33.376685 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-018214a5-59db-4a6e-ad61-1f7b73407e86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:33.377879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-018214a5-59db-4a6e-ad61-1f7b73407e86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:33.381284 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fc05c3d1-7b26-4858-862a-801fb8f44223 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:33.382272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fc05c3d1-7b26-4858-862a-801fb8f44223 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:33.384988 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-018214a5-59db-4a6e-ad61-1f7b73407e86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:33.385445 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-018214a5-59db-4a6e-ad61-1f7b73407e86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:33.386242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-018214a5-59db-4a6e-ad61-1f7b73407e86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:33.386682 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-018214a5-59db-4a6e-ad61-1f7b73407e86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:33.388861 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc05c3d1-7b26-4858-862a-801fb8f44223 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:33.389412 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc05c3d1-7b26-4858-862a-801fb8f44223 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:33.390038 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc05c3d1-7b26-4858-862a-801fb8f44223 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:33.390660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc05c3d1-7b26-4858-862a-801fb8f44223 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:33.475581 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-018214a5-59db-4a6e-ad61-1f7b73407e86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 0.102997 Jan 27 16:04:33.478952 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 162/330] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:33 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:33.482387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fc05c3d1-7b26-4858-862a-801fb8f44223 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.105380 Jan 27 16:04:33.483032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 169/331] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:33 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:04:33.565211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:33.566084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:33.573091 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:33.573533 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:33.574405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:33.574840 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:33.770894 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:33.780318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-090b2e20-35d0-462c-9c32-0093c6dd38e5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.219079 Jan 27 16:04:33.781139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 163/332] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:33 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:34.328151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1310746616", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "428491c7-1dfc-4e6f-a1ce-ef805c994d7c"}]}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:34.386507 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] validate_networks() for [('428491c7-1dfc-4e6f-a1ce-ef805c994d7c', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:04:34.486441 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-85d9ee80-f16e-4f89-93c2-55f6ad73e449 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:34.487395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-85d9ee80-f16e-4f89-93c2-55f6ad73e449 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:34.494007 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85d9ee80-f16e-4f89-93c2-55f6ad73e449 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.494457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85d9ee80-f16e-4f89-93c2-55f6ad73e449 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.495290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85d9ee80-f16e-4f89-93c2-55f6ad73e449 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.495730 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85d9ee80-f16e-4f89-93c2-55f6ad73e449 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.572548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-85d9ee80-f16e-4f89-93c2-55f6ad73e449 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 0.090218 Jan 27 16:04:34.576384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 164/333] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:34 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:34.578766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-135640f3-2d66-47ac-87c1-5b3ebdfc41a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:34.580768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-135640f3-2d66-47ac-87c1-5b3ebdfc41a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:34.587924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-135640f3-2d66-47ac-87c1-5b3ebdfc41a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.588359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-135640f3-2d66-47ac-87c1-5b3ebdfc41a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.589298 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-135640f3-2d66-47ac-87c1-5b3ebdfc41a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.589701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-135640f3-2d66-47ac-87c1-5b3ebdfc41a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.671158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-135640f3-2d66-47ac-87c1-5b3ebdfc41a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.096130 Jan 27 16:04:34.671943 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 165/334] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:34 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:34.806013 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:34.807559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:34.814052 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:04:34.815022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:04:34.815685 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:04:34.816110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:04:34.816534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:04:34.818077 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.818726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.819667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.820282 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.831339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.831787 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.832602 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:34.833045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:34.852135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:04:34.857648 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for user 4a8173ea1633470785f53cd6fc0e9e77 and project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:04:34.873421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:04:34.875995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:04:34.928650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f05b2047-40a0-4260-aa56-48106dba7958 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606506 Jan 27 16:04:34.929878 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 170/335] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:04:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:04:34.940456 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e719a78d-af69-481a-91ef-a2dfad342db2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:34.941286 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e719a78d-af69-481a-91ef-a2dfad342db2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:34.992287 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:35.005947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-825e6bee-33ab-413e-8e7f-8a3a6e9775a5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.206743 Jan 27 16:04:35.007175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 166/336] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:34 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:35.013830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e719a78d-af69-481a-91ef-a2dfad342db2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:35.020864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e719a78d-af69-481a-91ef-a2dfad342db2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1218 microversion: 2.1 time: 0.084700 Jan 27 16:04:35.021676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 171/337] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:34 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:35.585997 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f89b0a56-d649-401f-8de8-6dedc258c398 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:35.587395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f89b0a56-d649-401f-8de8-6dedc258c398 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:35.598683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f89b0a56-d649-401f-8de8-6dedc258c398 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:35.599374 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f89b0a56-d649-401f-8de8-6dedc258c398 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:35.600693 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f89b0a56-d649-401f-8de8-6dedc258c398 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:35.601364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f89b0a56-d649-401f-8de8-6dedc258c398 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:35.685942 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a90f6647-300c-4b62-a315-ee67ff577e7e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:35.688935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a90f6647-300c-4b62-a315-ee67ff577e7e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:35.696620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f89b0a56-d649-401f-8de8-6dedc258c398 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 0.116362 Jan 27 16:04:35.700548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 167/338] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:35 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:35.707935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a90f6647-300c-4b62-a315-ee67ff577e7e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:35.708514 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a90f6647-300c-4b62-a315-ee67ff577e7e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:35.709962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a90f6647-300c-4b62-a315-ee67ff577e7e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:35.710734 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a90f6647-300c-4b62-a315-ee67ff577e7e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:35.816523 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a90f6647-300c-4b62-a315-ee67ff577e7e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 14 microversion: 2.1 time: 0.136778 Jan 27 16:04:35.817650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 172/339] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:35 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:36.023421 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:36.024154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:36.033471 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.033931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.034751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.035221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.040033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:36.041000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:36.050014 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.050583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.051906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.052735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.170741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:36.183103 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d0a0fb67-0a93-49e1-af4a-8d58e2a59177 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1270 microversion: 2.1 time: 0.144877 Jan 27 16:04:36.192608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 173/340] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:36 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:36.216174 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:36.225675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6d2f344f-5331-4502-8fad-59f01fe3b78e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.206067 Jan 27 16:04:36.226465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 168/341] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:36 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:36.710079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ee358447-0c5b-4638-bbda-7ab5b7d019a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:36.711095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ee358447-0c5b-4638-bbda-7ab5b7d019a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:36.722698 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee358447-0c5b-4638-bbda-7ab5b7d019a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.725337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee358447-0c5b-4638-bbda-7ab5b7d019a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.726921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee358447-0c5b-4638-bbda-7ab5b7d019a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.727652 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee358447-0c5b-4638-bbda-7ab5b7d019a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.828672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-791b5994-2768-4bae-ac32-7374d8f02fc8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:36.829605 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-791b5994-2768-4bae-ac32-7374d8f02fc8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:36.842527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-791b5994-2768-4bae-ac32-7374d8f02fc8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.842527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-791b5994-2768-4bae-ac32-7374d8f02fc8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.842527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-791b5994-2768-4bae-ac32-7374d8f02fc8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:36.842527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-791b5994-2768-4bae-ac32-7374d8f02fc8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:36.856509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ee358447-0c5b-4638-bbda-7ab5b7d019a7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 14 microversion: 2.20 time: 0.151095 Jan 27 16:04:36.857754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 174/342] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:36 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:37.015510 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-791b5994-2768-4bae-ac32-7374d8f02fc8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 4516 microversion: 2.1 time: 0.190165 Jan 27 16:04:37.016431 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 169/343] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:36 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 4516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:37.206080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:37.207593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:37.221906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:37.224745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:37.226396 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:37.227768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:37.243770 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:37.244646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:37.259801 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:37.264690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:37.266033 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:37.268364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:37.506487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:37.513998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-efe9bafa-717b-4f29-991c-dca142ef1e6c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.316086 Jan 27 16:04:37.514575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 175/344] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:37 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:37.612294 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:37.622238 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-557526df-eb9d-47db-a205-c359a683a614 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.383460 Jan 27 16:04:37.623648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 170/345] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:37 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:37.876024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-96416fe1-896a-47f8-8c8a-0a1a365bf076 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:37.877838 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-96416fe1-896a-47f8-8c8a-0a1a365bf076 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:37.888223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-96416fe1-896a-47f8-8c8a-0a1a365bf076 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:37.889154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-96416fe1-896a-47f8-8c8a-0a1a365bf076 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:37.890346 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-96416fe1-896a-47f8-8c8a-0a1a365bf076 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:37.891077 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-96416fe1-896a-47f8-8c8a-0a1a365bf076 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.009448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-96416fe1-896a-47f8-8c8a-0a1a365bf076 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 6451 microversion: 2.20 time: 0.144467 Jan 27 16:04:38.010268 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 176/346] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:37 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 6451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:04:38.030358 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ff975270-5523-491d-b941-caa7c932ae0c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:38.032541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ff975270-5523-491d-b941-caa7c932ae0c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:38.039694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff975270-5523-491d-b941-caa7c932ae0c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:38.040516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff975270-5523-491d-b941-caa7c932ae0c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.041520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff975270-5523-491d-b941-caa7c932ae0c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:38.042119 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff975270-5523-491d-b941-caa7c932ae0c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.103915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-a0e0e300-e9d4-42e4-a70d-c5d44c3d62bd req-c081552b-a7da-400c-ae98-8f66c5956c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8473746f-8e75-4ea0-a903-ccb17613eb4c", "tag": "7cedd957-2069-4ea7-b587-46284400992b"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:38.106036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:04:38.106036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:04:38.122517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-a0e0e300-e9d4-42e4-a70d-c5d44c3d62bd req-c081552b-a7da-400c-ae98-8f66c5956c7d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:38.123531 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-a0e0e300-e9d4-42e4-a70d-c5d44c3d62bd req-c081552b-a7da-400c-ae98-8f66c5956c7d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.139395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-a0e0e300-e9d4-42e4-a70d-c5d44c3d62bd req-c081552b-a7da-400c-ae98-8f66c5956c7d service nova] Creating event network-changed:7cedd957-2069-4ea7-b587-46284400992b for instance 8473746f-8e75-4ea0-a903-ccb17613eb4c on hv-cinder-82635 Jan 27 16:04:38.144888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-a0e0e300-e9d4-42e4-a70d-c5d44c3d62bd req-c081552b-a7da-400c-ae98-8f66c5956c7d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053428 Jan 27 16:04:38.145967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 177/347] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:38.167807 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ff975270-5523-491d-b941-caa7c932ae0c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 7937 microversion: 2.1 time: 0.143784 Jan 27 16:04:38.168519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 171/348] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:38 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 7937 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:38.536766 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:38.537633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:38.544130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:38.544898 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.545949 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:38.546637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.642859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:38.646559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:38.658371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:38.660112 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.661445 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:38.662044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:38.812325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:38.823219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-78eb3180-119c-46cb-b1b0-5bf981457634 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.291498 Jan 27 16:04:38.823993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 178/349] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:38 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:38.867268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:38.897614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b34dfab5-aefa-453a-808d-fd158ea3ef6c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.259334 Jan 27 16:04:38.899024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 172/350] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:38 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:39.020607 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-68d5c46c-def8-4b30-afb8-8fc7b97ef366 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:39.021522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-68d5c46c-def8-4b30-afb8-8fc7b97ef366 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:39.028212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68d5c46c-def8-4b30-afb8-8fc7b97ef366 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.028866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68d5c46c-def8-4b30-afb8-8fc7b97ef366 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:39.029823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68d5c46c-def8-4b30-afb8-8fc7b97ef366 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.030408 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68d5c46c-def8-4b30-afb8-8fc7b97ef366 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:39.150756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-68d5c46c-def8-4b30-afb8-8fc7b97ef366 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 9491 microversion: 2.20 time: 0.133617 Jan 27 16:04:39.151746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 179/351] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:39 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 9491 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:04:39.179007 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-68fe91f1-db77-478e-b073-e465aec30897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:39.179967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-68fe91f1-db77-478e-b073-e465aec30897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:39.186944 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68fe91f1-db77-478e-b073-e465aec30897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.187559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68fe91f1-db77-478e-b073-e465aec30897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:39.188884 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68fe91f1-db77-478e-b073-e465aec30897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.189309 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68fe91f1-db77-478e-b073-e465aec30897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:39.325971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-68fe91f1-db77-478e-b073-e465aec30897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 10939 microversion: 2.1 time: 0.149639 Jan 27 16:04:39.326940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 173/352] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:39 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 10939 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:39.840275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:39.840978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:39.850381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.851943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:39.853365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.854000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:39.920303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:39.921310 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:39.930136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.931318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:39.933086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:39.934150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:40.051688 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:40.071457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a3357407-2464-41ce-a3e4-8ced1e75d469 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.229015 Jan 27 16:04:40.073489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 180/353] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:39 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:40.117341 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:40.125920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d43ce615-5ddf-4505-9101-6fee406ab97a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.213519 Jan 27 16:04:40.126495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 174/354] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:39 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:40.163407 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-86d3e97d-936e-4cff-a6a0-88ff002907d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:40.164321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-86d3e97d-936e-4cff-a6a0-88ff002907d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:40.170421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86d3e97d-936e-4cff-a6a0-88ff002907d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:40.170941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86d3e97d-936e-4cff-a6a0-88ff002907d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:40.171670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86d3e97d-936e-4cff-a6a0-88ff002907d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:40.172134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-86d3e97d-936e-4cff-a6a0-88ff002907d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:40.351857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-86d3e97d-936e-4cff-a6a0-88ff002907d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 12882 microversion: 2.20 time: 0.189322 Jan 27 16:04:40.358765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5d1b53cd-31dc-4008-9e99-82c5e1c0c12e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:40.360097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 181/355] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:40 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 12882 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:40.360789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5d1b53cd-31dc-4008-9e99-82c5e1c0c12e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:40.370700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5d1b53cd-31dc-4008-9e99-82c5e1c0c12e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:40.371197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5d1b53cd-31dc-4008-9e99-82c5e1c0c12e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:40.372022 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5d1b53cd-31dc-4008-9e99-82c5e1c0c12e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:40.372492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5d1b53cd-31dc-4008-9e99-82c5e1c0c12e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:40.602051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5d1b53cd-31dc-4008-9e99-82c5e1c0c12e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 15025 microversion: 2.1 time: 0.268037 Jan 27 16:04:40.606520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 175/356] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:40 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 15025 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:04:41.098113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:41.101704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:41.111176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.111946 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.113298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.113888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.143684 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:41.144376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:41.158342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.158797 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.159902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.160854 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.285855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:41.296145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-de0b2bed-3b42-4bec-9864-414d7fb3a95e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.207260 Jan 27 16:04:41.306134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 182/357] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:41 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:41.311020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:41.311825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:41.315687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:41.318567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.319275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.320269 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.320881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.323511 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1ca086ff-beae-4c5d-9048-f18647cf608c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.183845 Jan 27 16:04:41.324226 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 176/358] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:41 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:41.362911 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:04:41.364955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f45d0736-1c36-4898-a909-db85f58a0f23 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:41.365963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f45d0736-1c36-4898-a909-db85f58a0f23 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:41.372195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f45d0736-1c36-4898-a909-db85f58a0f23 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.372647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f45d0736-1c36-4898-a909-db85f58a0f23 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.374409 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f45d0736-1c36-4898-a909-db85f58a0f23 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.374898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f45d0736-1c36-4898-a909-db85f58a0f23 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.470684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e78e6c4a-7c7b-4c9f-ab22-d5ab7536001b tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 204 len: 0 microversion: 2.1 time: 0.162780 Jan 27 16:04:41.471480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 183/359] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:04:41 2022] DELETE /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:04:41.482325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:41.483061 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:41.493779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.494249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.495294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.495882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.497376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f45d0736-1c36-4898-a909-db85f58a0f23 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 15064 microversion: 2.20 time: 0.136455 Jan 27 16:04:41.503049 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 177/360] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:41 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 15064 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:41.614111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b83e82ce-d296-45bf-9176-5a9d3c3ce12c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:41.615533 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b83e82ce-d296-45bf-9176-5a9d3c3ce12c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:41.623542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b83e82ce-d296-45bf-9176-5a9d3c3ce12c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.624093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b83e82ce-d296-45bf-9176-5a9d3c3ce12c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.625550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b83e82ce-d296-45bf-9176-5a9d3c3ce12c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:41.626057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b83e82ce-d296-45bf-9176-5a9d3c3ce12c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:41.644107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:41.652857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f1fbcda3-b197-4c64-a3ef-973ebbda9dec tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1553 microversion: 2.1 time: 0.175648 Jan 27 16:04:41.653488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 184/361] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:41 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:41.769976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b83e82ce-d296-45bf-9176-5a9d3c3ce12c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 16877 microversion: 2.1 time: 0.159593 Jan 27 16:04:41.773805 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 178/362] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:41 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 16877 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:04:42.313270 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:42.313888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:42.320196 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.320657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.321443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.321875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.341111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:42.341810 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:42.348723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.349508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.350379 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.350891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.499095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:42.507967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-14b2ec31-b2d7-4c9d-a229-3999844e42c6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.199036 Jan 27 16:04:42.508867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 185/363] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:42 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:42.513506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e7d9fce1-e740-4e9b-875d-b33bcace517d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:42.514601 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e7d9fce1-e740-4e9b-875d-b33bcace517d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:42.521370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7d9fce1-e740-4e9b-875d-b33bcace517d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.521901 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7d9fce1-e740-4e9b-875d-b33bcace517d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.523119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7d9fce1-e740-4e9b-875d-b33bcace517d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.523970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7d9fce1-e740-4e9b-875d-b33bcace517d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.524558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:42.532354 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e704225e-c328-4449-847f-8a9fba73dd83 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.195031 Jan 27 16:04:42.533136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 179/364] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:42 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:42.631863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e7d9fce1-e740-4e9b-875d-b33bcace517d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 17443 microversion: 2.20 time: 0.121556 Jan 27 16:04:42.632501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 186/365] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:42 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 17443 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:42.669516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:42.670238 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:42.677129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.677656 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.678489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.678926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.782505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a2e294b7-176b-4ddc-865e-f443405ad864 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:42.783902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a2e294b7-176b-4ddc-865e-f443405ad864 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:42.791157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a2e294b7-176b-4ddc-865e-f443405ad864 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.791392 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a2e294b7-176b-4ddc-865e-f443405ad864 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.792243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a2e294b7-176b-4ddc-865e-f443405ad864 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:42.792637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a2e294b7-176b-4ddc-865e-f443405ad864 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:42.826405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:42.839409 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fca3ba0c-0d29-47aa-b50a-8389b3aacb15 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1553 microversion: 2.1 time: 0.173516 Jan 27 16:04:42.840001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 180/366] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:42 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:42.901851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a2e294b7-176b-4ddc-865e-f443405ad864 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 17602 microversion: 2.1 time: 0.123547 Jan 27 16:04:42.903466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 187/367] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:42 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 17602 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:04:43.528151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:43.528762 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:43.536459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.537441 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.538266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.538691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.552417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:43.553585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:43.564016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.564720 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.565902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.566521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.717648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:43.726968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d449000c-76d0-4c49-acaf-013131f729f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.203373 Jan 27 16:04:43.727810 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 181/368] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:43 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:43.734234 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-93836a8d-128c-4c18-877c-ac98c4e24559 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:43.735498 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-93836a8d-128c-4c18-877c-ac98c4e24559 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:43.742424 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-93836a8d-128c-4c18-877c-ac98c4e24559 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.743414 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-93836a8d-128c-4c18-877c-ac98c4e24559 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.744521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-93836a8d-128c-4c18-877c-ac98c4e24559 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.745022 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-93836a8d-128c-4c18-877c-ac98c4e24559 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.754417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:43.765964 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-09808484-c3e0-4fb0-a1e7-957fcef6ff48 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.216721 Jan 27 16:04:43.766645 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 188/369] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:43 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:43.857331 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:43.858121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:43.869721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.870190 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.870407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-93836a8d-128c-4c18-877c-ac98c4e24559 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 17659 microversion: 2.20 time: 0.140236 Jan 27 16:04:43.871224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 182/370] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:43 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 17659 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:43.871527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.882383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.913942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-81511ee5-d03b-4f3d-9217-661b9a9c8d87 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:43.914950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-81511ee5-d03b-4f3d-9217-661b9a9c8d87 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:43.927180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81511ee5-d03b-4f3d-9217-661b9a9c8d87 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.927647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81511ee5-d03b-4f3d-9217-661b9a9c8d87 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:43.928451 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81511ee5-d03b-4f3d-9217-661b9a9c8d87 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:43.934376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81511ee5-d03b-4f3d-9217-661b9a9c8d87 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:44.045592 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-81511ee5-d03b-4f3d-9217-661b9a9c8d87 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 18728 microversion: 2.1 time: 0.135443 Jan 27 16:04:44.049400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 183/371] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:43 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 18728 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:04:44.049547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:44.057264 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9bc40465-2751-45b3-a0f9-9fa132746065 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1553 microversion: 2.1 time: 0.204386 Jan 27 16:04:44.058107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 189/372] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:43 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:44.744320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:44.745013 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:44.752298 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:44.752748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:44.753564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:44.754002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:44.785221 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:44.786027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:44.798848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:44.799370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:44.800168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:44.800608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:44.903955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:44.911838 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d07256bc-e806-421a-8e8a-8ce70ec12a5e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.171574 Jan 27 16:04:44.912397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 184/373] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:44 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:44.916707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-57c56adb-ff0f-4b83-8175-18bc3afc33e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:44.917636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-57c56adb-ff0f-4b83-8175-18bc3afc33e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:44.923505 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-57c56adb-ff0f-4b83-8175-18bc3afc33e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:44.923954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-57c56adb-ff0f-4b83-8175-18bc3afc33e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:44.924859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-57c56adb-ff0f-4b83-8175-18bc3afc33e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:44.925313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-57c56adb-ff0f-4b83-8175-18bc3afc33e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:44.939953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:44.947287 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fb63377b-f7f7-4e27-8d2f-f24c20a212f5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.167430 Jan 27 16:04:44.947857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 190/374] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:44 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:45.057912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-be05c819-9db4-4d38-a48c-14e4cb05824b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:45.058750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-be05c819-9db4-4d38-a48c-14e4cb05824b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:45.065066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be05c819-9db4-4d38-a48c-14e4cb05824b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:45.065524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be05c819-9db4-4d38-a48c-14e4cb05824b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:45.066512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be05c819-9db4-4d38-a48c-14e4cb05824b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:45.066943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be05c819-9db4-4d38-a48c-14e4cb05824b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:45.107504 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-57c56adb-ff0f-4b83-8175-18bc3afc33e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 18915 microversion: 2.20 time: 0.193833 Jan 27 16:04:45.111163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 185/375] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:44 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 18915 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:45.112917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:45.113600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:45.128824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:45.129272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:45.130060 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:45.130492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:45.269338 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:45.278960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c61552db-2f36-40e5-941e-8142d39aeff8 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1553 microversion: 2.1 time: 0.169680 Jan 27 16:04:45.279545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 186/376] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:45 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:45.867305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-a84cc2c7-4757-40db-9bd2-abc142fb7f2f req-ee6c9a6e-7d66-4eca-9564-456117e7d420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c098b0b1-0d8f-4c24-8c24-721f965786f4", "name": "network-vif-deleted", "tag": "e530d2d9-0967-4022-9957-d2c0df7e0250"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:45.868955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:04:45.868955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:04:45.876911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-a84cc2c7-4757-40db-9bd2-abc142fb7f2f req-ee6c9a6e-7d66-4eca-9564-456117e7d420 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:45.877353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-a84cc2c7-4757-40db-9bd2-abc142fb7f2f req-ee6c9a6e-7d66-4eca-9564-456117e7d420 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:45.887792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-a84cc2c7-4757-40db-9bd2-abc142fb7f2f req-ee6c9a6e-7d66-4eca-9564-456117e7d420 service nova] Creating event network-vif-deleted:e530d2d9-0967-4022-9957-d2c0df7e0250 for instance c098b0b1-0d8f-4c24-8c24-721f965786f4 on hv-cinder-82635 Jan 27 16:04:45.892475 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-a84cc2c7-4757-40db-9bd2-abc142fb7f2f req-ee6c9a6e-7d66-4eca-9564-456117e7d420 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028803 Jan 27 16:04:45.893034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 187/377] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:45.928546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:45.929224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:45.935246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:45.935693 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:45.936472 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:45.936905 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:46.067494 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:46.074608 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f5e99d55-cd92-4118-98ef-11461b0a50b7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.149937 Jan 27 16:04:46.075199 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 188/378] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:45 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:46.079371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:46.079965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:46.085219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:46.085668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:46.086434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:46.086865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:46.213224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:46.220872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2e869725-ce63-43c7-964d-0dcd386bcda6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.144744 Jan 27 16:04:46.221433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 189/379] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:46 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:46.225827 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b77186d6-9fcc-4bb6-b9d6-7516051f1593 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:46.226771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b77186d6-9fcc-4bb6-b9d6-7516051f1593 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:46.232218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77186d6-9fcc-4bb6-b9d6-7516051f1593 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:46.232661 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77186d6-9fcc-4bb6-b9d6-7516051f1593 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:46.233435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77186d6-9fcc-4bb6-b9d6-7516051f1593 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:46.233867 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b77186d6-9fcc-4bb6-b9d6-7516051f1593 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:49.142329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-be05c819-9db4-4d38-a48c-14e4cb05824b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 21658 microversion: 2.1 time: 4.088114 Jan 27 16:04:49.146144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 191/380] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:45 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 21658 bytes in 4090 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:04:49.148078 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:49.148772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:49.156611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:49.157058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:49.157907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:49.159092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:49.232271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:49.240743 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-620fde91-91c3-4443-b2ed-66015f27237c tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1511 microversion: 2.1 time: 0.096401 Jan 27 16:04:49.241298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 192/381] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:49 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:49.245717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:49.246318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:49.252559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:49.253007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:49.253788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:49.254273 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:49.328055 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b77186d6-9fcc-4bb6-b9d6-7516051f1593 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 23603 microversion: 2.20 time: 3.104727 Jan 27 16:04:49.328735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 190/382] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:46 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 23603 bytes in 3107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:49.334502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:49.335330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:49.342406 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:49.342954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:49.344363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:49.344796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:49.389718 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:49.397427 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-05360671-328b-4a99-a15a-89f4240ca614 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.155178 Jan 27 16:04:49.398002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 193/383] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:49 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:49.473726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:49.481860 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-394c3d87-f95a-43c5-9bb4-b951645ab1cf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.151757 Jan 27 16:04:49.482423 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 191/384] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:49 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:50.153481 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8db3f665-e6fc-4e69-809b-469474f3c915 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:50.154457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8db3f665-e6fc-4e69-809b-469474f3c915 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:50.161888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8db3f665-e6fc-4e69-809b-469474f3c915 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.162384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8db3f665-e6fc-4e69-809b-469474f3c915 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.163309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8db3f665-e6fc-4e69-809b-469474f3c915 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.163803 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8db3f665-e6fc-4e69-809b-469474f3c915 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.257781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:50.258388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:50.264623 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.265587 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.266363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.266796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.284754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8db3f665-e6fc-4e69-809b-469474f3c915 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 24583 microversion: 2.1 time: 0.134794 Jan 27 16:04:50.288535 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 194/385] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:50 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 24583 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:50.332634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:50.340638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dc141e81-fb1e-41d9-9d7b-d7b848ad6f52 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1346 microversion: 2.1 time: 0.086491 Jan 27 16:04:50.341206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 192/386] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:50 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:50.344440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0aa44c9b-f29c-423a-af55-7f061c2e5477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:50.345484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0aa44c9b-f29c-423a-af55-7f061c2e5477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:50.351976 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0aa44c9b-f29c-423a-af55-7f061c2e5477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.352430 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0aa44c9b-f29c-423a-af55-7f061c2e5477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.353199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0aa44c9b-f29c-423a-af55-7f061c2e5477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.353631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0aa44c9b-f29c-423a-af55-7f061c2e5477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.414484 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:50.415110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:50.421167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.421629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.422438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.422876 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.474774 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0aa44c9b-f29c-423a-af55-7f061c2e5477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 24290 microversion: 2.20 time: 0.134706 Jan 27 16:04:50.475491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 195/387] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:50 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 24290 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:50.500160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:50.500848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:50.507787 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.508234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.509011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:50.509445 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:50.563191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:50.571348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8e2ba31b-0815-497c-8a00-819b3d6f823c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.160169 Jan 27 16:04:50.571941 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 193/388] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:50 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:50.655762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:50.665485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-81c453d3-5648-4417-8f79-0f9061bc8d78 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.170035 Jan 27 16:04:50.666871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 196/389] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:50 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:51.298379 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8dcd992a-d707-4037-a698-5ac278607ee1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:51.300107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8dcd992a-d707-4037-a698-5ac278607ee1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:51.306324 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8dcd992a-d707-4037-a698-5ac278607ee1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.306866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8dcd992a-d707-4037-a698-5ac278607ee1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.307755 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8dcd992a-d707-4037-a698-5ac278607ee1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.308264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8dcd992a-d707-4037-a698-5ac278607ee1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.355077 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-4f5ce944-be0c-4ad0-b7bd-b4eede65a2a1 req-105b966a-bfda-4ad5-bd23-2e23a6efc445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8473746f-8e75-4ea0-a903-ccb17613eb4c", "name": "network-vif-plugged", "status": "completed", "tag": "7cedd957-2069-4ea7-b587-46284400992b"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:51.357492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:04:51.357492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:04:51.367713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-4f5ce944-be0c-4ad0-b7bd-b4eede65a2a1 req-105b966a-bfda-4ad5-bd23-2e23a6efc445 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.368154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-4f5ce944-be0c-4ad0-b7bd-b4eede65a2a1 req-105b966a-bfda-4ad5-bd23-2e23a6efc445 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.381777 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-4f5ce944-be0c-4ad0-b7bd-b4eede65a2a1 req-105b966a-bfda-4ad5-bd23-2e23a6efc445 service nova] Creating event network-vif-plugged:7cedd957-2069-4ea7-b587-46284400992b for instance 8473746f-8e75-4ea0-a903-ccb17613eb4c on hv-cinder-82635 Jan 27 16:04:51.388157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-4f5ce944-be0c-4ad0-b7bd-b4eede65a2a1 req-105b966a-bfda-4ad5-bd23-2e23a6efc445 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038293 Jan 27 16:04:51.388975 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 197/390] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:04:51.395118 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:51.395748 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:51.413357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.414241 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.422845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.422845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.426911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8dcd992a-d707-4037-a698-5ac278607ee1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 25005 microversion: 2.1 time: 0.134166 Jan 27 16:04:51.428184 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 194/391] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:51 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 25005 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:51.454026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.454650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.455168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lazy-loading 'fault' on Instance uuid c098b0b1-0d8f-4c24-8c24-721f965786f4 {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:04:51.504968 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127cb7e8d04b4b5a8a5efa2c50383df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a2b3a672744b885fb48a990f14fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:51.505807 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-541aec31-c694-4d39-b33d-fbcf85ed03aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:51.506822 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-541aec31-c694-4d39-b33d-fbcf85ed03aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:51.512025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5e914fd0-d19d-4adc-88d2-2f5e0797c5c7 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 200 len: 1305 microversion: 2.1 time: 0.121573 Jan 27 16:04:51.512603 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 198/392] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:51 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:51.527606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-541aec31-c694-4d39-b33d-fbcf85ed03aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.528067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-541aec31-c694-4d39-b33d-fbcf85ed03aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.529167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-541aec31-c694-4d39-b33d-fbcf85ed03aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.529606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-541aec31-c694-4d39-b33d-fbcf85ed03aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.588627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:51.588627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:51.595322 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.595776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.596574 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.597016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.678932 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-541aec31-c694-4d39-b33d-fbcf85ed03aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 24860 microversion: 2.20 time: 0.178366 Jan 27 16:04:51.684281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 195/393] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:51 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 24860 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:51.685666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:51.686595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:51.699303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.699758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.700568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:51.701011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:51.811108 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:51.819270 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4f7dfcef-d697-413e-923c-c170d15289af tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.234920 Jan 27 16:04:51.819857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 199/394] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:51 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:51.851832 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:51.859341 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9ebb3eb5-2493-4897-aa81-cdfee15f3284 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.178290 Jan 27 16:04:51.859938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 196/395] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:51 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:52.441502 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-49c9ec06-0a9a-4a59-afdc-aa08b2bced40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:52.443771 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-49c9ec06-0a9a-4a59-afdc-aa08b2bced40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:52.456624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c9ec06-0a9a-4a59-afdc-aa08b2bced40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.457341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c9ec06-0a9a-4a59-afdc-aa08b2bced40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.458207 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c9ec06-0a9a-4a59-afdc-aa08b2bced40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.458748 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c9ec06-0a9a-4a59-afdc-aa08b2bced40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.529165 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:52.529856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:52.536855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.537384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.538362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.538888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.551321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-49c9ec06-0a9a-4a59-afdc-aa08b2bced40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 25606 microversion: 2.1 time: 0.114583 Jan 27 16:04:52.552410 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 200/396] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:52 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 25606 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:52.559186 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] HTTP exception thrown: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. Jan 27 16:04:52.559798 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Returning 404 to user: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:04:52.560634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6cf593c8-dc13-435c-b97d-1f6a1a106f25 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 404 len: 111 microversion: 2.1 time: 0.035084 Jan 27 16:04:52.561194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 197/397] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:52 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:04:52.674191 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:52.675543 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:52.682917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.683406 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.684202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.684639 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.693587 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3541e6de-0f21-4ae5-8544-d895b6491927 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:52.694850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3541e6de-0f21-4ae5-8544-d895b6491927 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:52.708237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3541e6de-0f21-4ae5-8544-d895b6491927 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.708693 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3541e6de-0f21-4ae5-8544-d895b6491927 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.709498 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3541e6de-0f21-4ae5-8544-d895b6491927 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.709605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] HTTP exception thrown: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. Jan 27 16:04:52.709947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3541e6de-0f21-4ae5-8544-d895b6491927 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.710128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Returning 404 to user: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:04:52.711199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-345bc82a-2eac-4043-bc7d-5a616e1c3c49 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041257 Jan 27 16:04:52.711979 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 201/398] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:04:52 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:04:52.836568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:52.837175 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:52.844253 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.844604 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.845824 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.846499 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.902809 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3541e6de-0f21-4ae5-8544-d895b6491927 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 25471 microversion: 2.20 time: 0.212706 Jan 27 16:04:52.904687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 198/399] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:52 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 25471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:04:52.927658 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:52.929637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:52.948536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.950564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:52.952871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:52.954440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:53.090115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:53.099229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9e6f1894-c596-4811-b17b-07d341e6b384 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1318 microversion: 2.1 time: 0.266652 Jan 27 16:04:53.099809 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 202/400] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:52 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:53.121549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:53.129168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-625a7f88-f813-448c-ba95-93ba1fd5cfcf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.220652 Jan 27 16:04:53.129728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 199/401] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:52 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:53.565857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-13a056c4-f0b0-43af-aa13-4186300490aa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:53.567130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-13a056c4-f0b0-43af-aa13-4186300490aa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:53.592545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13a056c4-f0b0-43af-aa13-4186300490aa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:53.592956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13a056c4-f0b0-43af-aa13-4186300490aa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:53.593750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13a056c4-f0b0-43af-aa13-4186300490aa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:53.594183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13a056c4-f0b0-43af-aa13-4186300490aa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:53.722307 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-13a056c4-f0b0-43af-aa13-4186300490aa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 25986 microversion: 2.1 time: 0.161967 Jan 27 16:04:53.722959 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 203/402] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:53 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 25986 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:53.918389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7881688a-c327-48e0-bcef-bda104896cd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:53.919329 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7881688a-c327-48e0-bcef-bda104896cd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:53.925972 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7881688a-c327-48e0-bcef-bda104896cd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:53.926880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7881688a-c327-48e0-bcef-bda104896cd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:53.927899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7881688a-c327-48e0-bcef-bda104896cd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:53.928474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7881688a-c327-48e0-bcef-bda104896cd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.024779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7881688a-c327-48e0-bcef-bda104896cd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 25852 microversion: 2.20 time: 0.110073 Jan 27 16:04:54.026996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:54.027810 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:54.029866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 200/403] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:53 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 25852 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:54.035586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.036182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.037223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.037750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.059023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] HTTP exception thrown: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. Jan 27 16:04:54.059702 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Returning 404 to user: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:04:54.060600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fecbead7-c928-4818-93d6-bbaca231c179 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 404 len: 111 microversion: 2.1 time: 0.037806 Jan 27 16:04:54.061238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 204/404] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:04:54 2022] DELETE /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:04:54.070099 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:54.070927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] [instance: c098b0b1-0d8f-4c24-8c24-721f965786f4] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:54.079544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.080206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.081209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.081791 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.097670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] HTTP exception thrown: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. Jan 27 16:04:54.098512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] Returning 404 to user: Instance c098b0b1-0d8f-4c24-8c24-721f965786f4 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:04:54.099537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-427f077b-5b09-4c9c-99ce-bdc88a994279 tempest-DeleteServersTestJSON-1383023015 tempest-DeleteServersTestJSON-1383023015-project] 10.222.0.61 "GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4" status: 404 len: 111 microversion: 2.1 time: 0.033879 Jan 27 16:04:54.100297 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 201/405] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:54 2022] GET /compute/v2.1/servers/c098b0b1-0d8f-4c24-8c24-721f965786f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:04:54.117676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:54.118736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:54.127234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.127897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.128899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.129764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.148046 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:54.148960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:54.159977 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.160432 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.161243 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.161679 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.368252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:54.389310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-73e22a04-fbc5-4dfd-ae07-a7212d2ff455 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1507 microversion: 2.1 time: 0.276567 Jan 27 16:04:54.390556 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 205/406] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:54 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:54.413215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b82e1b36-35cd-4051-a4db-54334f168f37"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:54.415093 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:54.434106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.437525 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.438427 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.438960 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.509317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:54.517265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d49f4e2c-3bfd-4a40-8753-d5028b6b7932 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.374827 Jan 27 16:04:54.517848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 202/407] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:54 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:54.556237 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] HTTP exception thrown: Invalid volume: volume b82e1b36-35cd-4051-a4db-54334f168f37 is already attached to instances: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee Jan 27 16:04:54.557477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Returning 400 to user: Invalid volume: volume b82e1b36-35cd-4051-a4db-54334f168f37 is already attached to instances: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:04:54.558173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6f0a2d40-bdfc-4c47-a56e-5e794d2fd865 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149501 Jan 27 16:04:54.562469 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 206/408] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:04:54 2022] POST /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:04:54.665789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:54.667033 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:54.676943 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.677751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.678794 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.679662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.735575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-195490de-cbcb-4f37-b9b2-5a650b50f41d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:54.736670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-195490de-cbcb-4f37-b9b2-5a650b50f41d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:54.752394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-195490de-cbcb-4f37-b9b2-5a650b50f41d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.752959 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-195490de-cbcb-4f37-b9b2-5a650b50f41d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.754152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-195490de-cbcb-4f37-b9b2-5a650b50f41d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:54.754789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-195490de-cbcb-4f37-b9b2-5a650b50f41d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:54.872903 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-195490de-cbcb-4f37-b9b2-5a650b50f41d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 26614 microversion: 2.1 time: 0.141742 Jan 27 16:04:54.874784 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 207/409] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:54 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 26614 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:54.904854 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lazy-loading 'services' on Instance uuid 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:04:55.048193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-632d4f3e-0c7f-4e1f-9c52-ce3126ad79f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:55.049182 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ebab17ad-ee9f-4bf5-88ec-cb3f02c6c0de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments/b82e1b36-35cd-4051-a4db-54334f168f37" status: 202 len: 0 microversion: 2.1 time: 0.386937 Jan 27 16:04:55.049830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 203/410] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:04:54 2022] DELETE /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments/b82e1b36-35cd-4051-a4db-54334f168f37 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:04:55.050920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-632d4f3e-0c7f-4e1f-9c52-ce3126ad79f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:55.058881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e521a53f-c470-4de7-81e6-8b8b9c22bad1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:55.061625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e521a53f-c470-4de7-81e6-8b8b9c22bad1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:55.075377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e521a53f-c470-4de7-81e6-8b8b9c22bad1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.075914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e521a53f-c470-4de7-81e6-8b8b9c22bad1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.076830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e521a53f-c470-4de7-81e6-8b8b9c22bad1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.077558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e521a53f-c470-4de7-81e6-8b8b9c22bad1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.077942 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632d4f3e-0c7f-4e1f-9c52-ce3126ad79f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.079522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632d4f3e-0c7f-4e1f-9c52-ce3126ad79f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.080675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632d4f3e-0c7f-4e1f-9c52-ce3126ad79f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.081962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-632d4f3e-0c7f-4e1f-9c52-ce3126ad79f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.133217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e521a53f-c470-4de7-81e6-8b8b9c22bad1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077343 Jan 27 16:04:55.133217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 204/411] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:04:55 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:04:55.193466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-632d4f3e-0c7f-4e1f-9c52-ce3126ad79f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 26593 microversion: 2.20 time: 0.155002 Jan 27 16:04:55.195694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 208/412] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:55 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 26593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:55.561015 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:55.565559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:55.580078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.580538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.581545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.581817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.898032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-679f279a-901d-4895-8abe-a03d1de1614b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:55.899114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-679f279a-901d-4895-8abe-a03d1de1614b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:55.911442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-679f279a-901d-4895-8abe-a03d1de1614b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.913369 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-679f279a-901d-4895-8abe-a03d1de1614b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.915045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-679f279a-901d-4895-8abe-a03d1de1614b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:55.915174 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:55.915295 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-679f279a-901d-4895-8abe-a03d1de1614b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:55.923433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-14128efb-32c3-493b-bd63-3c2393a1c959 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.381088 Jan 27 16:04:55.932675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 205/413] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:55 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:56.040862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-679f279a-901d-4895-8abe-a03d1de1614b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 26988 microversion: 2.1 time: 0.153262 Jan 27 16:04:56.046014 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 209/414] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:55 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 26988 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:56.145333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c206fa95-e813-4cd0-96a6-81065895ed0c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:56.147652 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c206fa95-e813-4cd0-96a6-81065895ed0c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:56.154614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c206fa95-e813-4cd0-96a6-81065895ed0c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:56.155242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c206fa95-e813-4cd0-96a6-81065895ed0c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:56.156421 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c206fa95-e813-4cd0-96a6-81065895ed0c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:56.157089 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c206fa95-e813-4cd0-96a6-81065895ed0c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:56.193086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c206fa95-e813-4cd0-96a6-81065895ed0c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051938 Jan 27 16:04:56.193768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 206/415] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:04:56 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:04:56.205924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f944b069-7b17-450a-b713-55c3d60334c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:56.207391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f944b069-7b17-450a-b713-55c3d60334c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:56.215058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f944b069-7b17-450a-b713-55c3d60334c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:56.216013 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f944b069-7b17-450a-b713-55c3d60334c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:56.217158 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f944b069-7b17-450a-b713-55c3d60334c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:56.217943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f944b069-7b17-450a-b713-55c3d60334c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:56.383314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f944b069-7b17-450a-b713-55c3d60334c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 26997 microversion: 2.20 time: 0.181407 Jan 27 16:04:56.384233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 210/416] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:56 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 26997 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:56.940291 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:56.940877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:56.947574 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:56.948290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:56.949107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:56.949549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:57.057222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0562827b-e8a1-4cf7-b71f-be8262565cb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:57.059184 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0562827b-e8a1-4cf7-b71f-be8262565cb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:57.069613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0562827b-e8a1-4cf7-b71f-be8262565cb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:57.070582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0562827b-e8a1-4cf7-b71f-be8262565cb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:57.071847 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0562827b-e8a1-4cf7-b71f-be8262565cb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:57.072669 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0562827b-e8a1-4cf7-b71f-be8262565cb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:57.111378 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:57.120087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b27c07b2-c444-4878-8afd-cd59d4a4080f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.183476 Jan 27 16:04:57.129973 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 207/417] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:56 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:57.176609 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0562827b-e8a1-4cf7-b71f-be8262565cb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 27413 microversion: 2.1 time: 0.126871 Jan 27 16:04:57.180877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 211/418] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:57 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 27413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:04:57.207034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-19df3f56-68cc-4503-8756-0adff1e6bc7b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:57.208029 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-19df3f56-68cc-4503-8756-0adff1e6bc7b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:57.214693 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19df3f56-68cc-4503-8756-0adff1e6bc7b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:57.215208 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19df3f56-68cc-4503-8756-0adff1e6bc7b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:57.216383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19df3f56-68cc-4503-8756-0adff1e6bc7b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:57.216836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19df3f56-68cc-4503-8756-0adff1e6bc7b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:57.249927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-19df3f56-68cc-4503-8756-0adff1e6bc7b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048720 Jan 27 16:04:57.250490 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 208/419] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:04:57 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:04:57.398599 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8f2687c1-d701-4901-a40d-b99791784670 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:57.400243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8f2687c1-d701-4901-a40d-b99791784670 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:57.410464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f2687c1-d701-4901-a40d-b99791784670 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:57.411118 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f2687c1-d701-4901-a40d-b99791784670 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:57.412093 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f2687c1-d701-4901-a40d-b99791784670 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:57.412685 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f2687c1-d701-4901-a40d-b99791784670 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:57.472940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1706680629", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "428491c7-1dfc-4e6f-a1ce-ef805c994d7c"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:57.521846 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8f2687c1-d701-4901-a40d-b99791784670 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 27409 microversion: 2.20 time: 0.127837 Jan 27 16:04:57.527514 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] validate_networks() for [('428491c7-1dfc-4e6f-a1ce-ef805c994d7c', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:04:57.528366 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 212/420] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:57 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 27409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:57.995662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:04:57.996077 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:04:57.996596 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:04:57.996967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:04:57.997628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:04:58.012092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.012731 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.013744 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.014366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.032366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:04:58.036817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for user 4a8173ea1633470785f53cd6fc0e9e77 and project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:04:58.048669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:04:58.051224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:04:58.112025 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7fabf0c1-d31f-46c6-9386-b9965e6f186a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642820 Jan 27 16:04:58.113417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 209/421] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:04:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:04:58.129108 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6bc8dd2e-d331-477c-9199-a37c762cacfd tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:58.131984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6bc8dd2e-d331-477c-9199-a37c762cacfd tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:58.138432 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:58.139651 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:58.167216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.167777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.168622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.169053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.241173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6bc8dd2e-d331-477c-9199-a37c762cacfd tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:58.251082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6bc8dd2e-d331-477c-9199-a37c762cacfd tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1218 microversion: 2.1 time: 0.130945 Jan 27 16:04:58.254634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 213/422] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:58 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:58.268227 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6d3e916e-cdbb-4c32-b6d4-de3cddbeacc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:58.271956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6d3e916e-cdbb-4c32-b6d4-de3cddbeacc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:58.291307 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3e916e-cdbb-4c32-b6d4-de3cddbeacc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.292000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3e916e-cdbb-4c32-b6d4-de3cddbeacc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.293428 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3e916e-cdbb-4c32-b6d4-de3cddbeacc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.294080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3e916e-cdbb-4c32-b6d4-de3cddbeacc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.425615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:58.440844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a2773965-74e6-4f09-8bad-9535f088d36d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.306640 Jan 27 16:04:58.441631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 210/423] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:58 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:04:58.493573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6d3e916e-cdbb-4c32-b6d4-de3cddbeacc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 27536 microversion: 2.1 time: 0.237221 Jan 27 16:04:58.494499 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 214/424] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:58 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 27536 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:58.535407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bcf4641a-41f3-43b4-8fa7-cf9c00628409 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:58.537470 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bcf4641a-41f3-43b4-8fa7-cf9c00628409 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:58.545476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bcf4641a-41f3-43b4-8fa7-cf9c00628409 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.546407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bcf4641a-41f3-43b4-8fa7-cf9c00628409 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.550679 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bcf4641a-41f3-43b4-8fa7-cf9c00628409 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:58.551320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bcf4641a-41f3-43b4-8fa7-cf9c00628409 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:58.676592 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bcf4641a-41f3-43b4-8fa7-cf9c00628409 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 27745 microversion: 2.20 time: 0.145525 Jan 27 16:04:58.677453 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 211/425] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:58 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 27745 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:04:59.270295 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:59.271053 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:59.278135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.278608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.279421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.280025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.351858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:59.365356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-70765aae-06a7-47da-90cb-0a8282bc60f7 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1270 microversion: 2.1 time: 0.098219 Jan 27 16:04:59.365356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 215/426] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:59 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:59.457917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:04:59.459004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:59.467036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.468401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.468837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.469466 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.509598 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c6929f2e-9219-4a92-88e1-3a94a1da40d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:59.510893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c6929f2e-9219-4a92-88e1-3a94a1da40d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:59.526251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c6929f2e-9219-4a92-88e1-3a94a1da40d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.547092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c6929f2e-9219-4a92-88e1-3a94a1da40d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.551885 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c6929f2e-9219-4a92-88e1-3a94a1da40d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.552041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c6929f2e-9219-4a92-88e1-3a94a1da40d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.647366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:04:59.656850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-60427cfa-45bf-47a2-b44d-02d85e22af37 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.202721 Jan 27 16:04:59.657428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 212/427] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:04:59 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:04:59.688716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c5d13c03-1dc1-4d3d-b73a-d1af3b87ef4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:04:59.689961 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c5d13c03-1dc1-4d3d-b73a-d1af3b87ef4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:04:59.694345 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c6929f2e-9219-4a92-88e1-3a94a1da40d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 27660 microversion: 2.1 time: 0.191877 Jan 27 16:04:59.698939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 216/428] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:04:59 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 27660 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:04:59.706460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5d13c03-1dc1-4d3d-b73a-d1af3b87ef4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.707538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5d13c03-1dc1-4d3d-b73a-d1af3b87ef4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.713700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5d13c03-1dc1-4d3d-b73a-d1af3b87ef4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:04:59.714604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5d13c03-1dc1-4d3d-b73a-d1af3b87ef4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:04:59.914428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c5d13c03-1dc1-4d3d-b73a-d1af3b87ef4c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 27876 microversion: 2.20 time: 0.228851 Jan 27 16:04:59.915285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 213/429] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:04:59 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 27876 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:00.385684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:00.387820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:00.401354 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.402146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.403192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.403881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.488455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:00.500359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d0f06b68-b73c-4522-bde4-229b2e61f4f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1276 microversion: 2.1 time: 0.119515 Jan 27 16:05:00.501582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 217/430] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:00 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:00.675389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:00.676448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:00.684019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.684475 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.685282 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.685754 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.706634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-75f1e737-c673-4426-81ef-f47be3992c57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:00.707727 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-75f1e737-c673-4426-81ef-f47be3992c57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:00.714627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75f1e737-c673-4426-81ef-f47be3992c57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.715505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75f1e737-c673-4426-81ef-f47be3992c57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.716545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75f1e737-c673-4426-81ef-f47be3992c57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.717449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-75f1e737-c673-4426-81ef-f47be3992c57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.866839 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-75f1e737-c673-4426-81ef-f47be3992c57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 27854 microversion: 2.1 time: 0.162132 Jan 27 16:05:00.869444 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 218/431] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:00 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 27854 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:00.927425 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-53f76046-ad7f-413d-954a-f041c28b7c64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:00.928689 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-53f76046-ad7f-413d-954a-f041c28b7c64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:00.941989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53f76046-ad7f-413d-954a-f041c28b7c64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.943937 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53f76046-ad7f-413d-954a-f041c28b7c64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.944927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53f76046-ad7f-413d-954a-f041c28b7c64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:00.947226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-53f76046-ad7f-413d-954a-f041c28b7c64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:00.975843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:00.986555 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0721ec5f-55e5-4074-9b7c-909d4467449f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.316350 Jan 27 16:05:00.991622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 214/432] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:00 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:01.264563 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-53f76046-ad7f-413d-954a-f041c28b7c64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28041 microversion: 2.20 time: 0.340536 Jan 27 16:05:01.266483 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 219/433] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:00 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28041 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:01.518017 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:01.518900 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:01.527453 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:01.528241 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:01.529270 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:01.530484 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:01.768835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:01.777543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d0e06027-2200-4b42-acdc-aeab8d5457ad tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.263536 Jan 27 16:05:01.788702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 215/434] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:01 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:01.881934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5490d800-fada-4ca9-8706-cd57e3b85104 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:01.883157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5490d800-fada-4ca9-8706-cd57e3b85104 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:01.895330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5490d800-fada-4ca9-8706-cd57e3b85104 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:01.896749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5490d800-fada-4ca9-8706-cd57e3b85104 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:01.898442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5490d800-fada-4ca9-8706-cd57e3b85104 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:01.899519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5490d800-fada-4ca9-8706-cd57e3b85104 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.008384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:02.009521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:02.016463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:02.017404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.018405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:02.019047 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.051726 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5490d800-fada-4ca9-8706-cd57e3b85104 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.173601 Jan 27 16:05:02.053020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 220/435] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:01 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:02.104312 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-2acecb56-c5c4-45c8-a0c9-cc4a246c4208 req-dee46cff-78ad-4d6e-bf69-6eed2b449604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58c7f78-f603-48c5-abf5-7aa03f151ee1", "tag": "61551a6c-acfc-484d-95a8-88d5fd843807"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:02.106352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:05:02.106352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:05:02.116545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2acecb56-c5c4-45c8-a0c9-cc4a246c4208 req-dee46cff-78ad-4d6e-bf69-6eed2b449604 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:02.117199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2acecb56-c5c4-45c8-a0c9-cc4a246c4208 req-dee46cff-78ad-4d6e-bf69-6eed2b449604 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.131151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-2acecb56-c5c4-45c8-a0c9-cc4a246c4208 req-dee46cff-78ad-4d6e-bf69-6eed2b449604 service nova] Creating event network-changed:61551a6c-acfc-484d-95a8-88d5fd843807 for instance f58c7f78-f603-48c5-abf5-7aa03f151ee1 on hv-cinder-82635 Jan 27 16:05:02.136136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-2acecb56-c5c4-45c8-a0c9-cc4a246c4208 req-dee46cff-78ad-4d6e-bf69-6eed2b449604 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037110 Jan 27 16:05:02.136746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 221/436] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:05:02.278316 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-22e84e2e-3b9a-4b17-a083-49fa190e2964 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:02.279874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-22e84e2e-3b9a-4b17-a083-49fa190e2964 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:02.293420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:02.302773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-22e84e2e-3b9a-4b17-a083-49fa190e2964 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:02.308072 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-22e84e2e-3b9a-4b17-a083-49fa190e2964 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.310178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-70a7e5b0-cd4d-4bdc-a46b-d259aef09620 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.300323 Jan 27 16:05:02.311950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-22e84e2e-3b9a-4b17-a083-49fa190e2964 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:02.312787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 216/437] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:02 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:02.314904 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-22e84e2e-3b9a-4b17-a083-49fa190e2964 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.467021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-22e84e2e-3b9a-4b17-a083-49fa190e2964 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28293 microversion: 2.20 time: 0.192071 Jan 27 16:05:02.471537 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 222/438] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:02 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:02.798224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:02.799032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:02.809009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:02.809763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.812044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:02.812901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:02.994482 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:03.004890 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0d1d1c16-6d49-4fa0-880d-21b4e199181b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.211825 Jan 27 16:05:03.021214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 217/439] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:02 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:03.070340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7c706a6f-2a40-42ed-9fb0-04ee23e14c52 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:03.071820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7c706a6f-2a40-42ed-9fb0-04ee23e14c52 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:03.088795 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c706a6f-2a40-42ed-9fb0-04ee23e14c52 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:03.090247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c706a6f-2a40-42ed-9fb0-04ee23e14c52 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:03.090917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c706a6f-2a40-42ed-9fb0-04ee23e14c52 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:03.091380 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c706a6f-2a40-42ed-9fb0-04ee23e14c52 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:03.225510 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7c706a6f-2a40-42ed-9fb0-04ee23e14c52 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.164553 Jan 27 16:05:03.226765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 223/440] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:03 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:03.329958 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:03.330568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:03.337110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:03.337560 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:03.338362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:03.338799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:03.482996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b7efce4a-ba66-403b-bd7e-462370149691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:03.482996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b7efce4a-ba66-403b-bd7e-462370149691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:03.499035 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7efce4a-ba66-403b-bd7e-462370149691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:03.499035 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7efce4a-ba66-403b-bd7e-462370149691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:03.499035 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7efce4a-ba66-403b-bd7e-462370149691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:03.499035 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7efce4a-ba66-403b-bd7e-462370149691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:03.511629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:03.524723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cb45adf0-55a9-4d94-8ebb-bf29d70120d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.199010 Jan 27 16:05:03.525722 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 218/441] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:03 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:03.752711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b7efce4a-ba66-403b-bd7e-462370149691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.270024 Jan 27 16:05:03.752711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 224/442] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:03 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:04.023550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:04.024942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:04.031519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.031964 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.032744 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.033174 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.181858 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:04.203803 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-59df0f70-80e2-4662-88c1-965f6e848376 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.183742 Jan 27 16:05:04.204614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 219/443] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:04 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:04.238597 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8daba32e-26a9-4f9a-bde8-3957fa5ae6dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:04.240078 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8daba32e-26a9-4f9a-bde8-3957fa5ae6dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:04.246823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8daba32e-26a9-4f9a-bde8-3957fa5ae6dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.247565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8daba32e-26a9-4f9a-bde8-3957fa5ae6dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.248354 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8daba32e-26a9-4f9a-bde8-3957fa5ae6dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.248824 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8daba32e-26a9-4f9a-bde8-3957fa5ae6dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.352289 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8daba32e-26a9-4f9a-bde8-3957fa5ae6dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.117657 Jan 27 16:05:04.353025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 225/444] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:04 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:04.545432 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:04.546057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:04.554402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.554860 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.555790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.556228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.710265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:04.717745 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0cfe9717-8735-497a-aa55-49d0f333f799 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.176040 Jan 27 16:05:04.718629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 220/445] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:04 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:04.759485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3f4dfb79-0f5b-498c-89bc-65dbac9b3166 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:04.760541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3f4dfb79-0f5b-498c-89bc-65dbac9b3166 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:04.768679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3f4dfb79-0f5b-498c-89bc-65dbac9b3166 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.769169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3f4dfb79-0f5b-498c-89bc-65dbac9b3166 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.769965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3f4dfb79-0f5b-498c-89bc-65dbac9b3166 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:04.771063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3f4dfb79-0f5b-498c-89bc-65dbac9b3166 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:04.846714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3f4dfb79-0f5b-498c-89bc-65dbac9b3166 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.091364 Jan 27 16:05:04.847395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 226/446] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:04 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:05.221598 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:05.223524 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:05.231435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.232172 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.233541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.234354 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.367928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3225ea5f-45bd-4a0f-a855-6b624f35b670 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:05.368948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3225ea5f-45bd-4a0f-a855-6b624f35b670 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:05.376192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3225ea5f-45bd-4a0f-a855-6b624f35b670 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.376677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3225ea5f-45bd-4a0f-a855-6b624f35b670 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.377564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3225ea5f-45bd-4a0f-a855-6b624f35b670 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.378287 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3225ea5f-45bd-4a0f-a855-6b624f35b670 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.402494 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:05.418759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0a226140-c073-4cc0-b0a1-6aa63c23ad68 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.202237 Jan 27 16:05:05.428460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 221/447] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:05 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:05.463650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3225ea5f-45bd-4a0f-a855-6b624f35b670 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.102519 Jan 27 16:05:05.464297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 227/448] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:05 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:05.735141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:05.735788 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:05.743883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.744356 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.745154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.746188 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.860425 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f5ec23c1-615e-4c73-8427-cbbf4af475af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:05.861592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f5ec23c1-615e-4c73-8427-cbbf4af475af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:05.868493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f5ec23c1-615e-4c73-8427-cbbf4af475af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.868981 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f5ec23c1-615e-4c73-8427-cbbf4af475af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.869947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f5ec23c1-615e-4c73-8427-cbbf4af475af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:05.870576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f5ec23c1-615e-4c73-8427-cbbf4af475af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:05.890751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:05.898835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3b89d417-f655-45b5-abe2-352d089cdcc1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.167275 Jan 27 16:05:05.899439 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 222/449] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:05 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:05.951223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f5ec23c1-615e-4c73-8427-cbbf4af475af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.095701 Jan 27 16:05:05.952402 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 228/450] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:05 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:06.439610 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:06.439610 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:06.452450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.453344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:06.453776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.454136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:06.478594 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8de7ea5b-3fee-4096-bac1-02430ae15389 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:06.479709 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8de7ea5b-3fee-4096-bac1-02430ae15389 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:06.490839 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8de7ea5b-3fee-4096-bac1-02430ae15389 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.500930 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8de7ea5b-3fee-4096-bac1-02430ae15389 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:06.501840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8de7ea5b-3fee-4096-bac1-02430ae15389 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.502320 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8de7ea5b-3fee-4096-bac1-02430ae15389 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:06.643984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8de7ea5b-3fee-4096-bac1-02430ae15389 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.167168 Jan 27 16:05:06.643984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 229/451] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:06 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:06.666634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:06.683074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-322e491f-82a4-4ceb-a46c-9195efa4ee09 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.250341 Jan 27 16:05:06.683791 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 223/452] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:06 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:06.918340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:06.919055 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:06.926046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.926493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:06.927349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.927789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:06.966249 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a3311a83-2da0-4c16-9582-e71afeed62e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:06.968168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a3311a83-2da0-4c16-9582-e71afeed62e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:06.978700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3311a83-2da0-4c16-9582-e71afeed62e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.979464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3311a83-2da0-4c16-9582-e71afeed62e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:06.980580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3311a83-2da0-4c16-9582-e71afeed62e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:06.981197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3311a83-2da0-4c16-9582-e71afeed62e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:07.050966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a3311a83-2da0-4c16-9582-e71afeed62e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.090425 Jan 27 16:05:07.051773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 224/453] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:06 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:07.101512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:07.111914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a244d76c-5a82-4982-9872-6b0d47d30e7e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.197500 Jan 27 16:05:07.112492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 230/454] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:06 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:07.657850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cf392754-c638-4066-ab9e-b6ae77bdcfe6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:07.659779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cf392754-c638-4066-ab9e-b6ae77bdcfe6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:07.675189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf392754-c638-4066-ab9e-b6ae77bdcfe6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:07.675991 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf392754-c638-4066-ab9e-b6ae77bdcfe6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:07.676955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf392754-c638-4066-ab9e-b6ae77bdcfe6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:07.677581 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cf392754-c638-4066-ab9e-b6ae77bdcfe6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:07.703438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:07.704043 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:07.725488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:07.729767 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:07.730696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:07.731178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:07.782268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cf392754-c638-4066-ab9e-b6ae77bdcfe6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.130896 Jan 27 16:05:07.787760 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 225/455] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:07 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:07.881027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:07.888383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-05e5f14a-3771-462b-89f1-8fecfa660408 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.192043 Jan 27 16:05:07.889065 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 231/456] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:07 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:08.072868 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a5b1620b-82c2-46b7-873f-e77f4d041c0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:08.075136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a5b1620b-82c2-46b7-873f-e77f4d041c0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:08.096644 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5b1620b-82c2-46b7-873f-e77f4d041c0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.097928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5b1620b-82c2-46b7-873f-e77f4d041c0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.099773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5b1620b-82c2-46b7-873f-e77f4d041c0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.100430 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5b1620b-82c2-46b7-873f-e77f4d041c0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.132898 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:08.136980 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:08.146637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.147391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.148632 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.149288 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.285523 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a5b1620b-82c2-46b7-873f-e77f4d041c0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.225771 Jan 27 16:05:08.286510 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 226/457] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:08 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:08.303337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:08.313157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b7348fe9-d5e6-4bf9-a838-1ce4cff5dc12 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.184960 Jan 27 16:05:08.313157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 232/458] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:08 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:08.795585 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2d7dad53-970b-40f5-a959-eff630acfed1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:08.796631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d7dad53-970b-40f5-a959-eff630acfed1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:08.803595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7dad53-970b-40f5-a959-eff630acfed1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.804048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7dad53-970b-40f5-a959-eff630acfed1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.804850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7dad53-970b-40f5-a959-eff630acfed1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.805292 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7dad53-970b-40f5-a959-eff630acfed1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.906099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:08.906807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:08.918142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.918630 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.919470 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:08.919904 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:08.954601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2d7dad53-970b-40f5-a959-eff630acfed1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.162963 Jan 27 16:05:08.955535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 227/459] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:08 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:09.072677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:09.081290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1e7ad87f-8b30-4b7a-8de8-86e4bb483f26 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.179189 Jan 27 16:05:09.081882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 233/460] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:08 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:09.303067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6ab24111-12b8-493c-a383-8c3588773cf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:09.303067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6ab24111-12b8-493c-a383-8c3588773cf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:09.320047 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ab24111-12b8-493c-a383-8c3588773cf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:09.320572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ab24111-12b8-493c-a383-8c3588773cf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:09.321495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ab24111-12b8-493c-a383-8c3588773cf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:09.323476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ab24111-12b8-493c-a383-8c3588773cf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:09.329201 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:09.329956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:09.338336 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:09.338796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:09.340077 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:09.340413 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:09.402763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6ab24111-12b8-493c-a383-8c3588773cf5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.107808 Jan 27 16:05:09.403783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 228/461] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:09 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:09.502759 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:09.525797 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0d2292be-8a2b-47ab-840f-637294dc0505 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.200113 Jan 27 16:05:09.526600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 234/462] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:09 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:09.967723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-63cc6063-78ed-4289-bb81-ca819f22a533 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:09.969094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-63cc6063-78ed-4289-bb81-ca819f22a533 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:09.979440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63cc6063-78ed-4289-bb81-ca819f22a533 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:09.979898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63cc6063-78ed-4289-bb81-ca819f22a533 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:09.980726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63cc6063-78ed-4289-bb81-ca819f22a533 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:09.981173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63cc6063-78ed-4289-bb81-ca819f22a533 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:10.054649 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-63cc6063-78ed-4289-bb81-ca819f22a533 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.091607 Jan 27 16:05:10.059252 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 229/463] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:09 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:10.112228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:10.112938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:10.120967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:10.121414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:10.122476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:10.122936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:10.300516 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:10.308293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d67f8dce-e499-4366-99c8-6e1e7fb9822e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.201877 Jan 27 16:05:10.308995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 235/464] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:10 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:10.414785 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-68b6462a-e4ea-4817-9bd1-8f917c08b504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:10.416313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-68b6462a-e4ea-4817-9bd1-8f917c08b504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:10.423391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b6462a-e4ea-4817-9bd1-8f917c08b504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:10.423841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b6462a-e4ea-4817-9bd1-8f917c08b504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:10.424811 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b6462a-e4ea-4817-9bd1-8f917c08b504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:10.425239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b6462a-e4ea-4817-9bd1-8f917c08b504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:10.544548 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:10.546274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:10.554924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:10.556104 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:10.557296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:10.557953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:10.625701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-68b6462a-e4ea-4817-9bd1-8f917c08b504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.214950 Jan 27 16:05:10.630470 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 230/465] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:10 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:10.764262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:10.771750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6665db79-41b3-4082-b0a1-93bc39ffa579 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.232681 Jan 27 16:05:10.772335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 236/466] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:10 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:11.068157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-784c0048-02ea-4124-99cd-5f7056759df7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:11.069161 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-784c0048-02ea-4124-99cd-5f7056759df7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:11.079517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-784c0048-02ea-4124-99cd-5f7056759df7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.080221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-784c0048-02ea-4124-99cd-5f7056759df7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.081185 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-784c0048-02ea-4124-99cd-5f7056759df7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.081625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-784c0048-02ea-4124-99cd-5f7056759df7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.175367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-784c0048-02ea-4124-99cd-5f7056759df7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.111370 Jan 27 16:05:11.176620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 231/467] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:11 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:11.325967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:11.327256 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:11.337967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.338878 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.339539 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.340179 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.505421 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-065d9e20-7d11-416d-9262-b7e0141cccaa req-bedf716b-5cfd-47f6-a474-eeaec3c53235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58c7f78-f603-48c5-abf5-7aa03f151ee1", "name": "network-vif-plugged", "status": "completed", "tag": "61551a6c-acfc-484d-95a8-88d5fd843807"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:11.507717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:05:11.507717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:05:11.517403 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-065d9e20-7d11-416d-9262-b7e0141cccaa req-bedf716b-5cfd-47f6-a474-eeaec3c53235 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.518490 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-065d9e20-7d11-416d-9262-b7e0141cccaa req-bedf716b-5cfd-47f6-a474-eeaec3c53235 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.539492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-065d9e20-7d11-416d-9262-b7e0141cccaa req-bedf716b-5cfd-47f6-a474-eeaec3c53235 service nova] Creating event network-vif-plugged:61551a6c-acfc-484d-95a8-88d5fd843807 for instance f58c7f78-f603-48c5-abf5-7aa03f151ee1 on hv-cinder-82635 Jan 27 16:05:11.545726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-065d9e20-7d11-416d-9262-b7e0141cccaa req-bedf716b-5cfd-47f6-a474-eeaec3c53235 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045020 Jan 27 16:05:11.546465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 232/468] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:05:11.608042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:11.620882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-df02ea38-4092-431a-8a48-856108cade9f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.298660 Jan 27 16:05:11.621622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 237/469] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:11 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:11.648261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c265c8c2-4daa-4fe2-8b65-79681b5196e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:11.650046 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c265c8c2-4daa-4fe2-8b65-79681b5196e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:11.671821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c265c8c2-4daa-4fe2-8b65-79681b5196e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.673475 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c265c8c2-4daa-4fe2-8b65-79681b5196e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.675226 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c265c8c2-4daa-4fe2-8b65-79681b5196e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.676271 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c265c8c2-4daa-4fe2-8b65-79681b5196e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.792822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:11.793466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:11.801690 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.802231 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.803507 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:11.804152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:11.853435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c265c8c2-4daa-4fe2-8b65-79681b5196e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.212592 Jan 27 16:05:11.858102 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 233/470] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:11 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:12.086352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:12.094713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b81d8f53-97c6-4925-bec8-30030e84406f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1522 microversion: 2.1 time: 0.308695 Jan 27 16:05:12.095321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 238/471] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:11 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:12.188242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f4f65508-3aae-4bbc-a51e-306f72a20c6d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:12.189254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f4f65508-3aae-4bbc-a51e-306f72a20c6d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:12.196277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f4f65508-3aae-4bbc-a51e-306f72a20c6d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:12.196727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f4f65508-3aae-4bbc-a51e-306f72a20c6d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:12.197528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f4f65508-3aae-4bbc-a51e-306f72a20c6d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:12.197969 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f4f65508-3aae-4bbc-a51e-306f72a20c6d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:12.558056 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f4f65508-3aae-4bbc-a51e-306f72a20c6d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.373642 Jan 27 16:05:12.559116 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 234/472] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:12 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:12.646680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:12.647365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:12.653570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:12.654022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:12.654817 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:12.655294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:12.866399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-eb6f1060-b429-46fc-9843-a7216bf44946 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:12.867558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-eb6f1060-b429-46fc-9843-a7216bf44946 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:12.875536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eb6f1060-b429-46fc-9843-a7216bf44946 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:12.876074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eb6f1060-b429-46fc-9843-a7216bf44946 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:12.876945 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eb6f1060-b429-46fc-9843-a7216bf44946 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:12.877448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eb6f1060-b429-46fc-9843-a7216bf44946 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:12.913819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:12.924348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5eec9198-108a-4d00-ba36-7557e5053b1f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.281171 Jan 27 16:05:12.925155 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 239/473] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:12 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:12.974585 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-eb6f1060-b429-46fc-9843-a7216bf44946 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.112180 Jan 27 16:05:12.975289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 235/474] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:12 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:13.114493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:13.115193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:13.123815 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.124289 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.125081 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.125729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.288587 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:13.297281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-02eceba1-2c84-4441-b191-3519fda1b7d5 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1502 microversion: 2.1 time: 0.186505 Jan 27 16:05:13.298091 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 240/475] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:13 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:13.314070 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:13.314771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:13.321770 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.322508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.323327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.323757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.484549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:13.491954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a11076ee-63cc-49f9-b46f-f06c12c3573d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1514 microversion: 2.1 time: 0.181976 Jan 27 16:05:13.492520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 236/476] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:13 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:13.572285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bb5d41bb-b2b8-4b58-a3e1-3fa1b1a869c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:13.573391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bb5d41bb-b2b8-4b58-a3e1-3fa1b1a869c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:13.580731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb5d41bb-b2b8-4b58-a3e1-3fa1b1a869c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.581318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb5d41bb-b2b8-4b58-a3e1-3fa1b1a869c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.582369 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb5d41bb-b2b8-4b58-a3e1-3fa1b1a869c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.582909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb5d41bb-b2b8-4b58-a3e1-3fa1b1a869c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.674819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bb5d41bb-b2b8-4b58-a3e1-3fa1b1a869c2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.107742 Jan 27 16:05:13.676276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 241/477] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:13 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:13.941615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:13.942251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:13.948799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.949246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.950037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:13.950487 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:13.990953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0198d852-36a5-403d-b26d-f65103f2c69f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:13.998729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0198d852-36a5-403d-b26d-f65103f2c69f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:14.008062 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0198d852-36a5-403d-b26d-f65103f2c69f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:14.008606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0198d852-36a5-403d-b26d-f65103f2c69f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:14.009477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0198d852-36a5-403d-b26d-f65103f2c69f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:14.009997 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0198d852-36a5-403d-b26d-f65103f2c69f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:14.109613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:14.115918 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0198d852-36a5-403d-b26d-f65103f2c69f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.131044 Jan 27 16:05:14.116367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 242/478] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:13 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:14.119711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a988acb8-0688-4b9d-bef2-9f3f6c9952de tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1318 microversion: 2.1 time: 0.181520 Jan 27 16:05:14.120395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 237/479] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:13 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:14.688403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-046ab53b-c859-4342-8d76-4ca6e141d4ab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:14.689410 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-046ab53b-c859-4342-8d76-4ca6e141d4ab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:14.696555 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-046ab53b-c859-4342-8d76-4ca6e141d4ab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:14.697011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-046ab53b-c859-4342-8d76-4ca6e141d4ab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:14.697802 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-046ab53b-c859-4342-8d76-4ca6e141d4ab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:14.698245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-046ab53b-c859-4342-8d76-4ca6e141d4ab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:14.791893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-046ab53b-c859-4342-8d76-4ca6e141d4ab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.107408 Jan 27 16:05:14.792524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 243/480] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:14 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:15.128281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f6e8c4f9-5fdc-4757-87f1-8c7c82fdcdb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:15.129189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f6e8c4f9-5fdc-4757-87f1-8c7c82fdcdb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:15.135692 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6e8c4f9-5fdc-4757-87f1-8c7c82fdcdb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:15.136135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6e8c4f9-5fdc-4757-87f1-8c7c82fdcdb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:15.136926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6e8c4f9-5fdc-4757-87f1-8c7c82fdcdb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:15.137355 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6e8c4f9-5fdc-4757-87f1-8c7c82fdcdb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:15.137588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:15.138301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:15.151043 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:15.151475 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:15.152536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:15.152809 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:15.242408 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f6e8c4f9-5fdc-4757-87f1-8c7c82fdcdb3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.117535 Jan 27 16:05:15.243615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 238/481] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:15 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:15.294577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:15.302340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-03009203-ddb4-4cdd-9466-1daa5be7b078 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1507 microversion: 2.1 time: 0.168789 Jan 27 16:05:15.302907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 244/482] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:15 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:15.806522 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4e94377c-c4cc-4eb0-8927-55a07d9c9d5f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:15.807540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4e94377c-c4cc-4eb0-8927-55a07d9c9d5f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:15.814515 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4e94377c-c4cc-4eb0-8927-55a07d9c9d5f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:15.814966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4e94377c-c4cc-4eb0-8927-55a07d9c9d5f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:15.815782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4e94377c-c4cc-4eb0-8927-55a07d9c9d5f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:15.816258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4e94377c-c4cc-4eb0-8927-55a07d9c9d5f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:15.893548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4e94377c-c4cc-4eb0-8927-55a07d9c9d5f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.091948 Jan 27 16:05:15.897321 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 239/483] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:15 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:16.255032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4df201a8-0f57-46da-98ae-4808f84e7b64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:16.255957 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4df201a8-0f57-46da-98ae-4808f84e7b64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:16.262522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4df201a8-0f57-46da-98ae-4808f84e7b64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:16.262986 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4df201a8-0f57-46da-98ae-4808f84e7b64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:16.263800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4df201a8-0f57-46da-98ae-4808f84e7b64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:16.264299 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4df201a8-0f57-46da-98ae-4808f84e7b64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:16.360912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4df201a8-0f57-46da-98ae-4808f84e7b64 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.109468 Jan 27 16:05:16.363526 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 245/484] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:16 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:16.905748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-494f04d1-edd2-4fa3-aa3d-082fe4c07fa1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:16.906880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-494f04d1-edd2-4fa3-aa3d-082fe4c07fa1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:16.914309 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-494f04d1-edd2-4fa3-aa3d-082fe4c07fa1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:16.914757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-494f04d1-edd2-4fa3-aa3d-082fe4c07fa1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:16.915586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-494f04d1-edd2-4fa3-aa3d-082fe4c07fa1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:16.916187 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-494f04d1-edd2-4fa3-aa3d-082fe4c07fa1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:16.994521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-494f04d1-edd2-4fa3-aa3d-082fe4c07fa1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.093672 Jan 27 16:05:16.995316 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 240/485] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:16 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:17.018593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:17.019668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:17.031638 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:17.032636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:17.032874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:17.033319 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:17.059113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lazy-loading 'flavor' on Instance uuid e56702b3-830c-441b-b790-b13f42d20c0d {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:05:17.173361 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d8dab98a-bbf2-4a36-a571-d9b73cd8f3d8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action" status: 200 len: 32 microversion: 2.1 time: 0.159920 Jan 27 16:05:17.174361 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 246/486] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:17 2022] POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:05:17.184275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:17.185195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:17.192861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:17.193404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:17.194281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:17.194787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:17.352176 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:17.359760 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8c294922-5cad-4e06-9819-dc23cc9c676a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.180293 Jan 27 16:05:17.364560 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 241/487] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:17 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:17.378271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2d206ed8-c83f-4f15-978c-a4d78ad376fd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:17.379322 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2d206ed8-c83f-4f15-978c-a4d78ad376fd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:17.385977 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2d206ed8-c83f-4f15-978c-a4d78ad376fd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:17.386329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2d206ed8-c83f-4f15-978c-a4d78ad376fd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:17.387152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2d206ed8-c83f-4f15-978c-a4d78ad376fd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:17.387586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2d206ed8-c83f-4f15-978c-a4d78ad376fd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:17.473333 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2d206ed8-c83f-4f15-978c-a4d78ad376fd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.101616 Jan 27 16:05:17.473985 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 247/488] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:17 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:18.006994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-933c6330-ad25-4f42-9ee3-877dac942b90 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:18.007912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-933c6330-ad25-4f42-9ee3-877dac942b90 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:18.018863 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-933c6330-ad25-4f42-9ee3-877dac942b90 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.019332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-933c6330-ad25-4f42-9ee3-877dac942b90 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:18.020114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-933c6330-ad25-4f42-9ee3-877dac942b90 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.020546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-933c6330-ad25-4f42-9ee3-877dac942b90 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:18.094483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-933c6330-ad25-4f42-9ee3-877dac942b90 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.090879 Jan 27 16:05:18.095155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 242/489] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:18 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:18.377935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:18.383547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:18.391564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.392013 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:18.392801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.393236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:18.485640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ad3ac158-e57b-47c2-9fa6-0a8319a9a22e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:18.486681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ad3ac158-e57b-47c2-9fa6-0a8319a9a22e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:18.493668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad3ac158-e57b-47c2-9fa6-0a8319a9a22e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.494121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad3ac158-e57b-47c2-9fa6-0a8319a9a22e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:18.494929 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad3ac158-e57b-47c2-9fa6-0a8319a9a22e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.495397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad3ac158-e57b-47c2-9fa6-0a8319a9a22e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:18.546963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:18.554944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a0bbd047-c58f-46c7-8701-c2d3da70923c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.181462 Jan 27 16:05:18.555528 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 248/490] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:18 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:18.571474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ad3ac158-e57b-47c2-9fa6-0a8319a9a22e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.090426 Jan 27 16:05:18.572606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 243/491] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:18 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:18.758040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-68c2533f-9806-4d28-bdaf-020a18978fc5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24a7716c-550b-4bef-899e-391e24c035ed"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:18.759202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-68c2533f-9806-4d28-bdaf-020a18978fc5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:18.766915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68c2533f-9806-4d28-bdaf-020a18978fc5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.767875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68c2533f-9806-4d28-bdaf-020a18978fc5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:18.768816 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68c2533f-9806-4d28-bdaf-020a18978fc5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:18.769297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-68c2533f-9806-4d28-bdaf-020a18978fc5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:19.047926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-68c2533f-9806-4d28-bdaf-020a18978fc5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294780 Jan 27 16:05:19.048740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 249/492] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:05:18 2022] POST /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:05:19.112704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d053f135-6622-40b6-9670-f2bc1f439b99 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:19.114093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d053f135-6622-40b6-9670-f2bc1f439b99 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:19.123834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d053f135-6622-40b6-9670-f2bc1f439b99 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:19.124492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d053f135-6622-40b6-9670-f2bc1f439b99 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:19.125573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d053f135-6622-40b6-9670-f2bc1f439b99 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:19.133901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d053f135-6622-40b6-9670-f2bc1f439b99 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:19.226701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d053f135-6622-40b6-9670-f2bc1f439b99 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.119533 Jan 27 16:05:19.227385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 244/493] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:19 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:19.581666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:19.583387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:19.586308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3346b48d-04f5-43ec-8d20-2b6948371e26 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:19.587331 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3346b48d-04f5-43ec-8d20-2b6948371e26 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:19.594934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:19.595650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:19.596954 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:19.597111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3346b48d-04f5-43ec-8d20-2b6948371e26 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:19.597566 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3346b48d-04f5-43ec-8d20-2b6948371e26 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:19.598045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:19.598463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3346b48d-04f5-43ec-8d20-2b6948371e26 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:19.599088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3346b48d-04f5-43ec-8d20-2b6948371e26 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:19.716816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3346b48d-04f5-43ec-8d20-2b6948371e26 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.134475 Jan 27 16:05:19.720935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 245/494] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:19 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:19.787044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:19.802324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5574e415-63ef-4c62-9628-169cde669c67 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.226704 Jan 27 16:05:19.803427 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 250/495] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:19 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:20.242471 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e7a219d0-50b0-4bee-842e-0b1a0bf5a630 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:20.244304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e7a219d0-50b0-4bee-842e-0b1a0bf5a630 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:20.253718 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e7a219d0-50b0-4bee-842e-0b1a0bf5a630 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:20.254216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e7a219d0-50b0-4bee-842e-0b1a0bf5a630 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:20.255307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e7a219d0-50b0-4bee-842e-0b1a0bf5a630 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:20.255914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e7a219d0-50b0-4bee-842e-0b1a0bf5a630 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:20.353194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e7a219d0-50b0-4bee-842e-0b1a0bf5a630 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.115534 Jan 27 16:05:20.353940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 246/496] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:20 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:20.734418 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c9d35a8f-18bc-4bbe-a1bc-4bcacfe0fa37 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:20.735439 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c9d35a8f-18bc-4bbe-a1bc-4bcacfe0fa37 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:20.742282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9d35a8f-18bc-4bbe-a1bc-4bcacfe0fa37 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:20.742732 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9d35a8f-18bc-4bbe-a1bc-4bcacfe0fa37 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:20.743613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9d35a8f-18bc-4bbe-a1bc-4bcacfe0fa37 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:20.744107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9d35a8f-18bc-4bbe-a1bc-4bcacfe0fa37 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:20.820151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c9d35a8f-18bc-4bbe-a1bc-4bcacfe0fa37 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.091912 Jan 27 16:05:20.820956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 251/497] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:20 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:20.821775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:20.822716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:20.830587 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:20.831045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:20.832161 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:20.832542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:20.972467 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:20.980268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5ef09a77-16d1-4ee4-a7e7-edd3e8a642d6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.162337 Jan 27 16:05:20.988974 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 247/498] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:20 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:21.366893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-82555e75-8e1b-477a-8a77-6d9e54881e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:21.368570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-82555e75-8e1b-477a-8a77-6d9e54881e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:21.377844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82555e75-8e1b-477a-8a77-6d9e54881e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:21.378540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82555e75-8e1b-477a-8a77-6d9e54881e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:21.379698 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82555e75-8e1b-477a-8a77-6d9e54881e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:21.380316 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82555e75-8e1b-477a-8a77-6d9e54881e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:21.449090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-82555e75-8e1b-477a-8a77-6d9e54881e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.086152 Jan 27 16:05:21.449792 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 252/499] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:21 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:21.834082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e4de0fb9-cea6-43e1-94ba-8fcaa1f2c3c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:21.835142 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e4de0fb9-cea6-43e1-94ba-8fcaa1f2c3c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:21.845094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e4de0fb9-cea6-43e1-94ba-8fcaa1f2c3c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:21.845094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e4de0fb9-cea6-43e1-94ba-8fcaa1f2c3c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:21.845094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e4de0fb9-cea6-43e1-94ba-8fcaa1f2c3c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:21.845094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e4de0fb9-cea6-43e1-94ba-8fcaa1f2c3c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:21.943770 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e4de0fb9-cea6-43e1-94ba-8fcaa1f2c3c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.113599 Jan 27 16:05:21.944407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 248/500] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:21 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:22.007348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:22.007348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:22.011025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:22.011487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:22.014616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:22.015649 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:22.164055 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:22.171735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bb75d917-9fa4-4887-9c36-33653f4b4752 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.176353 Jan 27 16:05:22.172326 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 253/501] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:21 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:22.461586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0d207b0e-9c0c-46ae-b01f-4a4c49aa81ff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:22.462640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0d207b0e-9c0c-46ae-b01f-4a4c49aa81ff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:22.470715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d207b0e-9c0c-46ae-b01f-4a4c49aa81ff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:22.471507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d207b0e-9c0c-46ae-b01f-4a4c49aa81ff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:22.472391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d207b0e-9c0c-46ae-b01f-4a4c49aa81ff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:22.472927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d207b0e-9c0c-46ae-b01f-4a4c49aa81ff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:22.575495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0d207b0e-9c0c-46ae-b01f-4a4c49aa81ff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.117866 Jan 27 16:05:22.576209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 249/502] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:22 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:22.956539 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ab7cfa7b-087e-41b9-88f1-d996a1185e4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:22.957443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ab7cfa7b-087e-41b9-88f1-d996a1185e4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:22.963695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ab7cfa7b-087e-41b9-88f1-d996a1185e4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:22.964141 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ab7cfa7b-087e-41b9-88f1-d996a1185e4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:22.964918 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ab7cfa7b-087e-41b9-88f1-d996a1185e4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:22.965352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ab7cfa7b-087e-41b9-88f1-d996a1185e4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:23.040849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ab7cfa7b-087e-41b9-88f1-d996a1185e4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.088408 Jan 27 16:05:23.042035 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 254/503] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:22 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:23.191183 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:23.192494 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:23.199823 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:23.200272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:23.201253 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:23.201872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:23.372654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:23.381048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ea03c3b5-fadc-48d4-a15a-d225028bd120 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.194921 Jan 27 16:05:23.390806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 250/504] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:23 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:23.588122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ea1df5a3-762d-424f-beb8-ee0b37efb6fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:23.589122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ea1df5a3-762d-424f-beb8-ee0b37efb6fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:23.596478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea1df5a3-762d-424f-beb8-ee0b37efb6fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:23.596925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea1df5a3-762d-424f-beb8-ee0b37efb6fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:23.597707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea1df5a3-762d-424f-beb8-ee0b37efb6fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:23.598138 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea1df5a3-762d-424f-beb8-ee0b37efb6fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:23.689980 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ea1df5a3-762d-424f-beb8-ee0b37efb6fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.105599 Jan 27 16:05:23.690624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 255/505] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:23 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:24.052625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-53ae2555-f064-4f6f-b300-a871d7b81919 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:24.053537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-53ae2555-f064-4f6f-b300-a871d7b81919 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:24.060336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53ae2555-f064-4f6f-b300-a871d7b81919 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:24.060786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53ae2555-f064-4f6f-b300-a871d7b81919 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:24.061574 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53ae2555-f064-4f6f-b300-a871d7b81919 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:24.062004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53ae2555-f064-4f6f-b300-a871d7b81919 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:24.144223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-53ae2555-f064-4f6f-b300-a871d7b81919 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.095372 Jan 27 16:05:24.144883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 251/506] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:24 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:24.398044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:24.398764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:24.406168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:24.406623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:24.407430 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:24.407863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:24.539144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:24.547040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dbb68dea-d14b-475a-8dbe-faee00f4011a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.153011 Jan 27 16:05:24.547602 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 256/507] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:24 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:24.702224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-30071592-b92f-4396-ba0c-5556026e438f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:24.703362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-30071592-b92f-4396-ba0c-5556026e438f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:24.710205 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30071592-b92f-4396-ba0c-5556026e438f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:24.710654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30071592-b92f-4396-ba0c-5556026e438f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:24.711546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30071592-b92f-4396-ba0c-5556026e438f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:24.711989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30071592-b92f-4396-ba0c-5556026e438f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:24.798753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-30071592-b92f-4396-ba0c-5556026e438f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.100407 Jan 27 16:05:24.799352 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 252/508] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:24 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:25.156075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e85b16b2-c015-44ec-8dc9-16ba109da62e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:25.157010 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e85b16b2-c015-44ec-8dc9-16ba109da62e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:25.163297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e85b16b2-c015-44ec-8dc9-16ba109da62e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:25.163756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e85b16b2-c015-44ec-8dc9-16ba109da62e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:25.164580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e85b16b2-c015-44ec-8dc9-16ba109da62e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:25.165020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e85b16b2-c015-44ec-8dc9-16ba109da62e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:25.243641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e85b16b2-c015-44ec-8dc9-16ba109da62e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.091567 Jan 27 16:05:25.244753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 257/509] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:25 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:25.564201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:25.565175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:25.572358 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:25.573211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:25.574082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:25.574847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:25.720326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:25.728073 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9fdfa07c-8035-42d4-b6bf-64278fba5423 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.167827 Jan 27 16:05:25.728636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 253/510] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:25 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:25.813960 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-97bef5a6-4a51-4083-b48d-423356052d9e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:25.815631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-97bef5a6-4a51-4083-b48d-423356052d9e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:25.822921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97bef5a6-4a51-4083-b48d-423356052d9e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:25.823409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97bef5a6-4a51-4083-b48d-423356052d9e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:25.824236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97bef5a6-4a51-4083-b48d-423356052d9e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:25.824677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97bef5a6-4a51-4083-b48d-423356052d9e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:25.914821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-97bef5a6-4a51-4083-b48d-423356052d9e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.107404 Jan 27 16:05:25.915492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 258/511] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:25 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:26.256455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9913d300-2c37-4f81-aa65-860093427093 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:26.257381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9913d300-2c37-4f81-aa65-860093427093 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:26.263561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9913d300-2c37-4f81-aa65-860093427093 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.264012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9913d300-2c37-4f81-aa65-860093427093 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.264795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9913d300-2c37-4f81-aa65-860093427093 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.265228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9913d300-2c37-4f81-aa65-860093427093 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.343858 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9913d300-2c37-4f81-aa65-860093427093 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.091374 Jan 27 16:05:26.344541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 254/512] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:26 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:26.605040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24a7716c-550b-4bef-899e-391e24c035ed"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:26.606258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:26.614095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.614549 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.615371 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.615814 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.703168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] HTTP exception thrown: Invalid volume: volume 24a7716c-550b-4bef-899e-391e24c035ed is already attached to instances: f58c7f78-f603-48c5-abf5-7aa03f151ee1 Jan 27 16:05:26.703836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Returning 400 to user: Invalid volume: volume 24a7716c-550b-4bef-899e-391e24c035ed is already attached to instances: f58c7f78-f603-48c5-abf5-7aa03f151ee1 {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:05:26.704674 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-936a9a82-3215-44fb-b7eb-69fa5144d9f1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103869 Jan 27 16:05:26.705399 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 259/513] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:05:26 2022] POST /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:05:26.745877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:26.747469 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:26.754640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.755128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.756339 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.756787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.927811 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9ab40880-a670-4209-95d9-8f967b059bad tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:26.929257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9ab40880-a670-4209-95d9-8f967b059bad tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:26.935792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:26.944816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-37471aec-ff87-42fe-8602-1d13e4510818 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.203530 Jan 27 16:05:26.945721 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 255/514] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:26 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:26.959687 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9ab40880-a670-4209-95d9-8f967b059bad tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.960247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9ab40880-a670-4209-95d9-8f967b059bad tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.961381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9ab40880-a670-4209-95d9-8f967b059bad tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.962134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9ab40880-a670-4209-95d9-8f967b059bad tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.976437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:26.977431 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:26.985555 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.985997 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:26.987406 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:26.988100 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:27.070403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9ab40880-a670-4209-95d9-8f967b059bad tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.146363 Jan 27 16:05:27.074689 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 260/515] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:26 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:27.080426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lazy-loading 'services' on Instance uuid f58c7f78-f603-48c5-abf5-7aa03f151ee1 {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:05:27.154085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-01f6ffed-c34d-4dff-b056-29e23018efc9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments/24a7716c-550b-4bef-899e-391e24c035ed" status: 202 len: 0 microversion: 2.1 time: 0.187063 Jan 27 16:05:27.154701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 256/516] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:05:26 2022] DELETE /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments/24a7716c-550b-4bef-899e-391e24c035ed => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:27.163821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-74a36a12-1e35-49d8-91ba-ae088e06067e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:27.164830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-74a36a12-1e35-49d8-91ba-ae088e06067e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:27.177925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-74a36a12-1e35-49d8-91ba-ae088e06067e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:27.178444 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-74a36a12-1e35-49d8-91ba-ae088e06067e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:27.179468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-74a36a12-1e35-49d8-91ba-ae088e06067e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:27.180110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-74a36a12-1e35-49d8-91ba-ae088e06067e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:27.216841 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-74a36a12-1e35-49d8-91ba-ae088e06067e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057022 Jan 27 16:05:27.217670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 261/517] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:05:27 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:05:27.355650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-21b542ba-767f-438c-a47b-ead48e64ca84 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:27.357130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-21b542ba-767f-438c-a47b-ead48e64ca84 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:27.362759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21b542ba-767f-438c-a47b-ead48e64ca84 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:27.363266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21b542ba-767f-438c-a47b-ead48e64ca84 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:27.364039 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21b542ba-767f-438c-a47b-ead48e64ca84 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:27.364470 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21b542ba-767f-438c-a47b-ead48e64ca84 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:27.460496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-21b542ba-767f-438c-a47b-ead48e64ca84 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.109166 Jan 27 16:05:27.464460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 257/518] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:27 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:27.965790 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:27.968867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:27.975491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:27.975942 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:27.977668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:27.978788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:28.083220 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2b70923d-67d2-4275-b3dd-e4423d9045a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:28.096267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2b70923d-67d2-4275-b3dd-e4423d9045a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:28.114063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b70923d-67d2-4275-b3dd-e4423d9045a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:28.114517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b70923d-67d2-4275-b3dd-e4423d9045a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:28.115384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b70923d-67d2-4275-b3dd-e4423d9045a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:28.115828 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b70923d-67d2-4275-b3dd-e4423d9045a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:28.164152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:28.172172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d6a24adc-fcab-46b0-9f9f-8c6e5456ab28 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.212067 Jan 27 16:05:28.172898 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 262/519] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:27 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:28.202752 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2b70923d-67d2-4275-b3dd-e4423d9045a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.124388 Jan 27 16:05:28.203423 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 258/520] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:28 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:28.228682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ff74d1f5-fd43-4d08-8f94-0389c15accb2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:28.229692 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ff74d1f5-fd43-4d08-8f94-0389c15accb2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:28.237616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff74d1f5-fd43-4d08-8f94-0389c15accb2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:28.238076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff74d1f5-fd43-4d08-8f94-0389c15accb2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:28.239142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff74d1f5-fd43-4d08-8f94-0389c15accb2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:28.239582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff74d1f5-fd43-4d08-8f94-0389c15accb2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:28.272561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ff74d1f5-fd43-4d08-8f94-0389c15accb2 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Jan 27 16:05:28.273133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 263/521] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:05:28 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:05:28.472767 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8f865c6b-fdde-4136-81a9-98879b9cc61e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:28.473887 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8f865c6b-fdde-4136-81a9-98879b9cc61e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:28.482529 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f865c6b-fdde-4136-81a9-98879b9cc61e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:28.482899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f865c6b-fdde-4136-81a9-98879b9cc61e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:28.484144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f865c6b-fdde-4136-81a9-98879b9cc61e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:28.484144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f865c6b-fdde-4136-81a9-98879b9cc61e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:28.567599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8f865c6b-fdde-4136-81a9-98879b9cc61e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.099511 Jan 27 16:05:28.568851 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 259/522] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:28 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:29.190423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:29.191064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:29.197654 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.198136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:29.200410 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.200410 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:29.215142 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ab7317be-b47d-472b-99e1-1529f1c003de tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:29.216347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ab7317be-b47d-472b-99e1-1529f1c003de tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:29.223154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab7317be-b47d-472b-99e1-1529f1c003de tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.223758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab7317be-b47d-472b-99e1-1529f1c003de tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:29.224662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab7317be-b47d-472b-99e1-1529f1c003de tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.225347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab7317be-b47d-472b-99e1-1529f1c003de tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:29.326129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ab7317be-b47d-472b-99e1-1529f1c003de tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.115169 Jan 27 16:05:29.330702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 260/523] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:29 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:29.344346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dfd75c33-0eb2-41ca-b6da-fb2c84c08626 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:29.345526 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dfd75c33-0eb2-41ca-b6da-fb2c84c08626 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:29.354541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfd75c33-0eb2-41ca-b6da-fb2c84c08626 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.359853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfd75c33-0eb2-41ca-b6da-fb2c84c08626 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:29.360648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfd75c33-0eb2-41ca-b6da-fb2c84c08626 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.366192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfd75c33-0eb2-41ca-b6da-fb2c84c08626 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:29.380206 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:29.391010 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-64830b43-3af9-4aea-88f7-91a442b43d40 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.205390 Jan 27 16:05:29.393931 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 264/524] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:29 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:29.411886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dfd75c33-0eb2-41ca-b6da-fb2c84c08626 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079575 Jan 27 16:05:29.412685 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 261/525] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:05:29 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:05:29.584647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-27777b87-62d4-4a72-a963-5acac34de5d0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:29.586260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-27777b87-62d4-4a72-a963-5acac34de5d0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:29.599008 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27777b87-62d4-4a72-a963-5acac34de5d0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.599816 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27777b87-62d4-4a72-a963-5acac34de5d0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:29.601194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27777b87-62d4-4a72-a963-5acac34de5d0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:29.601973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27777b87-62d4-4a72-a963-5acac34de5d0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:30.337510 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ab45c8f7-e3ca-4e3e-89ce-cb16e4cac6f5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:30.338595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ab45c8f7-e3ca-4e3e-89ce-cb16e4cac6f5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:30.345124 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab45c8f7-e3ca-4e3e-89ce-cb16e4cac6f5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:30.345571 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab45c8f7-e3ca-4e3e-89ce-cb16e4cac6f5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:30.346361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab45c8f7-e3ca-4e3e-89ce-cb16e4cac6f5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:30.346795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ab45c8f7-e3ca-4e3e-89ce-cb16e4cac6f5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:33.609135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-27777b87-62d4-4a72-a963-5acac34de5d0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 4.032661 Jan 27 16:05:33.609770 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 265/526] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:29 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 4035 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:33.614645 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:33.615357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:33.622296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:33.622735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:33.624352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:33.624780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:33.644272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ab45c8f7-e3ca-4e3e-89ce-cb16e4cac6f5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 3.310278 Jan 27 16:05:33.644938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 262/527] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:30 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 3312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:33.649842 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ecaf0210-2880-41ca-a711-9b6605c34cb6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:33.650816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ecaf0210-2880-41ca-a711-9b6605c34cb6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:33.660084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ecaf0210-2880-41ca-a711-9b6605c34cb6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:33.660527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ecaf0210-2880-41ca-a711-9b6605c34cb6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:33.661307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ecaf0210-2880-41ca-a711-9b6605c34cb6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:33.661739 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ecaf0210-2880-41ca-a711-9b6605c34cb6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:33.692149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ecaf0210-2880-41ca-a711-9b6605c34cb6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Jan 27 16:05:33.692735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 263/528] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:05:33 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:05:33.755356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:33.763276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-075d4873-7544-405b-bd9d-35bd5332fe14 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.152358 Jan 27 16:05:33.764356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 266/529] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:33 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:34.621243 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b75cbe34-035e-4754-8e14-9ad091fc76c0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:34.622141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b75cbe34-035e-4754-8e14-9ad091fc76c0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:34.629221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b75cbe34-035e-4754-8e14-9ad091fc76c0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:34.629661 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b75cbe34-035e-4754-8e14-9ad091fc76c0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:34.630428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b75cbe34-035e-4754-8e14-9ad091fc76c0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:34.630855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b75cbe34-035e-4754-8e14-9ad091fc76c0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:34.658114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f255e7d1-f5cf-4124-a5c2-e6fad7fe978a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:34.659560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f255e7d1-f5cf-4124-a5c2-e6fad7fe978a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:34.666907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f255e7d1-f5cf-4124-a5c2-e6fad7fe978a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:34.667689 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f255e7d1-f5cf-4124-a5c2-e6fad7fe978a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:34.669023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f255e7d1-f5cf-4124-a5c2-e6fad7fe978a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:34.669023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f255e7d1-f5cf-4124-a5c2-e6fad7fe978a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:35.321568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b75cbe34-035e-4754-8e14-9ad091fc76c0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.704034 Jan 27 16:05:35.322295 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 264/530] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:34 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:35.327566 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-62a31edc-7183-49f2-9f1d-dd344f06f6bc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:35.328585 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-62a31edc-7183-49f2-9f1d-dd344f06f6bc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:35.336031 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-62a31edc-7183-49f2-9f1d-dd344f06f6bc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:35.336483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-62a31edc-7183-49f2-9f1d-dd344f06f6bc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:35.337290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-62a31edc-7183-49f2-9f1d-dd344f06f6bc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:35.337729 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-62a31edc-7183-49f2-9f1d-dd344f06f6bc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:35.368296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-62a31edc-7183-49f2-9f1d-dd344f06f6bc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Jan 27 16:05:35.368841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 265/531] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:05:35 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:05:35.373835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:35.374440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:35.380289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:35.380743 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:35.381591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:35.382026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:35.399759 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f255e7d1-f5cf-4124-a5c2-e6fad7fe978a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.746756 Jan 27 16:05:35.403875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 267/532] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:34 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:35.512755 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:35.520003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-be77e389-d62c-4f51-95df-73111e729aa7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.150232 Jan 27 16:05:35.520568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 266/533] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:35 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:36.333905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ce99987a-79da-4477-846c-9d445f92b659 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:36.334898 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ce99987a-79da-4477-846c-9d445f92b659 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:36.341739 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ce99987a-79da-4477-846c-9d445f92b659 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.342183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ce99987a-79da-4477-846c-9d445f92b659 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.342953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ce99987a-79da-4477-846c-9d445f92b659 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.343400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ce99987a-79da-4477-846c-9d445f92b659 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.379946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-81b3d854-4544-4f46-ac79-689a5e8936b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:36.380825 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-81b3d854-4544-4f46-ac79-689a5e8936b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:36.386932 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81b3d854-4544-4f46-ac79-689a5e8936b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.387402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81b3d854-4544-4f46-ac79-689a5e8936b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.388168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81b3d854-4544-4f46-ac79-689a5e8936b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.388598 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-81b3d854-4544-4f46-ac79-689a5e8936b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.416456 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-81b3d854-4544-4f46-ac79-689a5e8936b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040138 Jan 27 16:05:36.417000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 267/534] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:05:36 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:05:36.421158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2ca1767e-659d-451a-850b-0e882e01970d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:36.422068 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2ca1767e-659d-451a-850b-0e882e01970d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:36.427561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ca1767e-659d-451a-850b-0e882e01970d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.428004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ca1767e-659d-451a-850b-0e882e01970d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.428805 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ca1767e-659d-451a-850b-0e882e01970d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.429477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ca1767e-659d-451a-850b-0e882e01970d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.583938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2ca1767e-659d-451a-850b-0e882e01970d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.165698 Jan 27 16:05:36.584648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 268/535] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:36 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:36.589372 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:36.590047 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:36.596519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.596958 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.597728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:36.598155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:36.649826 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ce99987a-79da-4477-846c-9d445f92b659 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.319726 Jan 27 16:05:36.650715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 268/536] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:36 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:36.655246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-738929476", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "428491c7-1dfc-4e6f-a1ce-ef805c994d7c"}]}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:36.708098 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] validate_networks() for [('428491c7-1dfc-4e6f-a1ce-ef805c994d7c', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:05:36.729850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:36.738364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-15770dd3-3f11-44f3-8d37-15e5a6273191 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.152469 Jan 27 16:05:36.738843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 269/537] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:36 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:37.069385 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:05:37.069812 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:05:37.070285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:05:37.070692 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:05:37.071143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:05:37.080379 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.080829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.081647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.082084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.099171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:05:37.103271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Getting quotas for user 4a8173ea1633470785f53cd6fc0e9e77 and project 8ff07a1c1705459093c50413a35df253. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:05:37.114934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:05:37.117421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:05:37.162283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dc12a044-6464-488e-a6ff-e1f28594e787 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510562 Jan 27 16:05:37.163099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 269/538] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:05:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:05:37.173280 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ed6c4275-6760-4e77-901a-64d2596c980c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:37.173885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ed6c4275-6760-4e77-901a-64d2596c980c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:37.223989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ed6c4275-6760-4e77-901a-64d2596c980c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:37.230603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ed6c4275-6760-4e77-901a-64d2596c980c tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1217 microversion: 2.1 time: 0.061618 Jan 27 16:05:37.231209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 270/539] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:37 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1217 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:37.596727 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e2b07024-9bcb-40c3-8611-ca89320307ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:37.597840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e2b07024-9bcb-40c3-8611-ca89320307ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:37.604243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2b07024-9bcb-40c3-8611-ca89320307ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.604687 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2b07024-9bcb-40c3-8611-ca89320307ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.605494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2b07024-9bcb-40c3-8611-ca89320307ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.605924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2b07024-9bcb-40c3-8611-ca89320307ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.661546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0949e407-9593-4b8c-b468-a5d82284d8bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:37.662503 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0949e407-9593-4b8c-b468-a5d82284d8bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:37.669609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0949e407-9593-4b8c-b468-a5d82284d8bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.670085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0949e407-9593-4b8c-b468-a5d82284d8bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.670862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0949e407-9593-4b8c-b468-a5d82284d8bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.671319 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0949e407-9593-4b8c-b468-a5d82284d8bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.828337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e2b07024-9bcb-40c3-8611-ca89320307ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.236319 Jan 27 16:05:37.832187 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 270/540] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:37 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:37.832436 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0949e407-9593-4b8c-b468-a5d82284d8bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.174395 Jan 27 16:05:37.833096 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 271/541] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:37 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:37.833684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:37.834366 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:37.841194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.841636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.842417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:37.842842 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:37.975458 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:37.983003 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-570c9cd1-3c14-4c93-a5e3-b74523aaf036 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.152781 Jan 27 16:05:37.983977 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 271/542] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:37 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:38.249457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:38.250186 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:38.257523 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:38.257974 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:38.258790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:38.259260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:38.340018 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:38.348424 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8d63e31a-09b0-4b25-8a14-aee6ac85ef4b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1277 microversion: 2.1 time: 0.103807 Jan 27 16:05:38.351536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 272/543] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:38 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:38.842735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8e3df435-d786-4ebb-88b9-8e228ee40d05 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:38.844766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c31751f6-1544-4a85-91e1-6b7e54681550 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:38.845203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c31751f6-1544-4a85-91e1-6b7e54681550 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:38.846146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8e3df435-d786-4ebb-88b9-8e228ee40d05 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:38.853260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c31751f6-1544-4a85-91e1-6b7e54681550 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:38.853769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c31751f6-1544-4a85-91e1-6b7e54681550 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:38.854565 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c31751f6-1544-4a85-91e1-6b7e54681550 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:38.855236 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c31751f6-1544-4a85-91e1-6b7e54681550 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:38.855449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e3df435-d786-4ebb-88b9-8e228ee40d05 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:38.856098 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e3df435-d786-4ebb-88b9-8e228ee40d05 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:38.857026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e3df435-d786-4ebb-88b9-8e228ee40d05 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:38.858144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e3df435-d786-4ebb-88b9-8e228ee40d05 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:38.939075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c31751f6-1544-4a85-91e1-6b7e54681550 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.098860 Jan 27 16:05:38.940391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 273/544] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:38 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:38.960785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8e3df435-d786-4ebb-88b9-8e228ee40d05 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.124157 Jan 27 16:05:38.961558 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 272/545] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:38 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:39.004715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:39.005414 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:39.012401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.012857 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:39.014214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.014656 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:39.153771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:39.161561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3f821847-a080-45db-a2d7-df8287c6b042 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.160848 Jan 27 16:05:39.162111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 274/546] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:38 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:39.366318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:39.367022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:39.374612 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.375084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:39.375871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.376299 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:39.514485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:39.521814 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fb5ee291-ecfd-4092-8363-c6e35ea63fdc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.159608 Jan 27 16:05:39.522366 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 273/547] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:39 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:39.950962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a5f4f922-c798-4a69-bb8c-81ad59b58be8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:39.952168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a5f4f922-c798-4a69-bb8c-81ad59b58be8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:39.958131 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5f4f922-c798-4a69-bb8c-81ad59b58be8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.958563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5f4f922-c798-4a69-bb8c-81ad59b58be8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:39.959371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5f4f922-c798-4a69-bb8c-81ad59b58be8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.960002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a5f4f922-c798-4a69-bb8c-81ad59b58be8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:39.973564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2523f6c6-63ce-47c0-88d6-962a98a2bbfb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:39.974497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2523f6c6-63ce-47c0-88d6-962a98a2bbfb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:39.980752 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2523f6c6-63ce-47c0-88d6-962a98a2bbfb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.981384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2523f6c6-63ce-47c0-88d6-962a98a2bbfb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:39.982282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2523f6c6-63ce-47c0-88d6-962a98a2bbfb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:39.982723 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2523f6c6-63ce-47c0-88d6-962a98a2bbfb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:40.037071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a5f4f922-c798-4a69-bb8c-81ad59b58be8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.090510 Jan 27 16:05:40.038563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 275/548] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:39 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:40.104993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2523f6c6-63ce-47c0-88d6-962a98a2bbfb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.135467 Jan 27 16:05:40.105926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 274/549] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:39 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:40.147168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-f75593be-a6f5-4a55-bede-a24b2121c355 req-791af95e-eac9-4b4f-96de-84a9d3dad253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402", "tag": "24367130-5983-4920-adec-cf550eaa56f4"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:40.148792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:05:40.148792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:05:40.156445 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-f75593be-a6f5-4a55-bede-a24b2121c355 req-791af95e-eac9-4b4f-96de-84a9d3dad253 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:40.156907 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-f75593be-a6f5-4a55-bede-a24b2121c355 req-791af95e-eac9-4b4f-96de-84a9d3dad253 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:40.168310 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-f75593be-a6f5-4a55-bede-a24b2121c355 req-791af95e-eac9-4b4f-96de-84a9d3dad253 service nova] Creating event network-changed:24367130-5983-4920-adec-cf550eaa56f4 for instance a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 on hv-cinder-82635 Jan 27 16:05:40.174068 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-f75593be-a6f5-4a55-bede-a24b2121c355 req-791af95e-eac9-4b4f-96de-84a9d3dad253 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031202 Jan 27 16:05:40.174999 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 276/550] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:05:40.180270 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:40.182769 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:40.191758 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:40.192212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:40.192998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:40.193569 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:40.359075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:40.366911 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-494fec00-81ff-42e7-be56-1ff2d526d8db tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.192319 Jan 27 16:05:40.367515 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 275/551] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:40 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:40.539476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:40.540159 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:40.546680 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:40.547166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:40.547934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:40.548368 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:40.678354 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:40.685725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-755aaadd-b029-4938-93f9-e7f7c656e8f5 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.150703 Jan 27 16:05:40.686427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 277/552] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:40 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:41.049823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a58b559e-308f-4984-856d-ada72a990089 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:41.050732 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a58b559e-308f-4984-856d-ada72a990089 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:41.057042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a58b559e-308f-4984-856d-ada72a990089 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.057486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a58b559e-308f-4984-856d-ada72a990089 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.058261 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a58b559e-308f-4984-856d-ada72a990089 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.058694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a58b559e-308f-4984-856d-ada72a990089 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.116622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0fb72b1d-d128-4830-893b-f3b848fc69cf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:41.117535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0fb72b1d-d128-4830-893b-f3b848fc69cf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:41.124076 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0fb72b1d-d128-4830-893b-f3b848fc69cf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.124527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0fb72b1d-d128-4830-893b-f3b848fc69cf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.125316 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0fb72b1d-d128-4830-893b-f3b848fc69cf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.125750 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0fb72b1d-d128-4830-893b-f3b848fc69cf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.179395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a58b559e-308f-4984-856d-ada72a990089 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28351 microversion: 2.20 time: 0.133031 Jan 27 16:05:41.180067 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 276/553] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:41 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:41.281458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0fb72b1d-d128-4830-893b-f3b848fc69cf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.168275 Jan 27 16:05:41.285362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 278/554] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:41 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:41.385465 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:41.386150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:41.393525 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.393998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.394775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.395226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.605729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:41.612984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-51953340-b38a-4a3a-946e-8cb9fc1fd196 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.231490 Jan 27 16:05:41.613929 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 277/555] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:41 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:41.702511 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:41.703430 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:41.710564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.711192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.712021 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:41.712484 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:41.843125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:41.851560 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1dba210e-3449-4905-93dd-4b5e1a92b134 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.153723 Jan 27 16:05:41.852122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 279/556] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:41 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:42.190819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e1f8aacf-c0f7-4f89-8a55-77249f5e920a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:42.191800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e1f8aacf-c0f7-4f89-8a55-77249f5e920a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:42.198007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e1f8aacf-c0f7-4f89-8a55-77249f5e920a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:42.198478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e1f8aacf-c0f7-4f89-8a55-77249f5e920a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:42.199455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e1f8aacf-c0f7-4f89-8a55-77249f5e920a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:42.199892 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e1f8aacf-c0f7-4f89-8a55-77249f5e920a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:42.293650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5cce8675-c482-49cc-9e7a-473e797d44c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:42.295307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5cce8675-c482-49cc-9e7a-473e797d44c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:42.302968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cce8675-c482-49cc-9e7a-473e797d44c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:42.303452 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cce8675-c482-49cc-9e7a-473e797d44c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:42.313121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cce8675-c482-49cc-9e7a-473e797d44c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:42.313121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cce8675-c482-49cc-9e7a-473e797d44c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:43.849486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e1f8aacf-c0f7-4f89-8a55-77249f5e920a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28383 microversion: 2.20 time: 1.662117 Jan 27 16:05:43.850130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 278/557] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:42 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28383 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:43.855226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:43.855920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:43.860823 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5cce8675-c482-49cc-9e7a-473e797d44c4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 1.571117 Jan 27 16:05:43.861904 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 280/558] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:42 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:43.864044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:43.864200 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:43.865015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:43.865435 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:43.867075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:43.867786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:43.874921 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:43.875386 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:43.876179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:43.876616 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:44.011779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:44.011948 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:44.019255 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9a079a25-500b-4550-aa27-645b7278a52a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.156108 Jan 27 16:05:44.019429 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-87a9240d-1452-425b-81e3-2ce705b79baf tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.167935 Jan 27 16:05:44.020104 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 279/559] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:43 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:44.020216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 281/560] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:43 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:44.863621 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-40bcfd5c-4961-44e7-99b4-7559f930d8a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:44.864565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-40bcfd5c-4961-44e7-99b4-7559f930d8a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:44.873535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-58e42286-567e-4b0e-b7cc-2385ad615b16 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:44.874448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-58e42286-567e-4b0e-b7cc-2385ad615b16 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:44.880939 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40bcfd5c-4961-44e7-99b4-7559f930d8a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:44.881266 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40bcfd5c-4961-44e7-99b4-7559f930d8a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:44.882061 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40bcfd5c-4961-44e7-99b4-7559f930d8a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:44.882498 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40bcfd5c-4961-44e7-99b4-7559f930d8a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:44.888157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e42286-567e-4b0e-b7cc-2385ad615b16 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:44.888609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e42286-567e-4b0e-b7cc-2385ad615b16 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:44.889407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e42286-567e-4b0e-b7cc-2385ad615b16 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:44.889846 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e42286-567e-4b0e-b7cc-2385ad615b16 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.098718 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-40bcfd5c-4961-44e7-99b4-7559f930d8a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28641 microversion: 2.20 time: 0.239999 Jan 27 16:05:45.102922 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 280/561] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:44 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28641 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:45.106228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:45.107461 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:45.108103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-58e42286-567e-4b0e-b7cc-2385ad615b16 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28074 microversion: 2.1 time: 0.238372 Jan 27 16:05:45.109364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 282/562] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:44 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28074 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:45.114175 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.114700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.114811 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:45.115455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.115640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:45.115900 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.124706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.125139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.125926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.126360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.273919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:45.274140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:45.282566 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7cace52b-1063-4f80-acf7-4787c32466f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1500 microversion: 2.1 time: 0.172686 Jan 27 16:05:45.283169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 283/563] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:45 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1500 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:45.283564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-69ff87a9-0be4-4385-8109-6b3b451eebd1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.183114 Jan 27 16:05:45.284411 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 281/564] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:45 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:45.299683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a9e0ee5-a356-49a4-b744-f78a9df29662"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:45.300763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:45.306637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.307130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.307908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.308347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.332850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] HTTP exception thrown: Cannot 'attach_volume' instance e56702b3-830c-441b-b790-b13f42d20c0d while it is in vm_state rescued Jan 27 16:05:45.333438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Returning 409 to user: Cannot 'attach_volume' instance e56702b3-830c-441b-b790-b13f42d20c0d while it is in vm_state rescued {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:05:45.334254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-de6f7290-e435-4831-95ce-f83a1303a8a0 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038393 Jan 27 16:05:45.334785 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 284/565] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:05:45 2022] POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 27 16:05:45.343704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a41fda8d-3b4f-4d16-ae00-aa141c04eafa tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:45.344260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a41fda8d-3b4f-4d16-ae00-aa141c04eafa tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:45.350315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a41fda8d-3b4f-4d16-ae00-aa141c04eafa tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.350697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a41fda8d-3b4f-4d16-ae00-aa141c04eafa tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.351497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a41fda8d-3b4f-4d16-ae00-aa141c04eafa tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.351927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a41fda8d-3b4f-4d16-ae00-aa141c04eafa tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.429243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a41fda8d-3b4f-4d16-ae00-aa141c04eafa tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.089575 Jan 27 16:05:45.429962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 282/566] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:45 2022] POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:45.438026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:45.438627 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:45.445043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.445493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.446337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:45.446776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:45.585629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:45.592911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-41d0e1e5-d4a0-4883-87d3-bc6438a3d1d3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1508 microversion: 2.1 time: 0.158985 Jan 27 16:05:45.593468 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 285/567] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:45 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:46.110389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8f77f8db-0f46-4e14-8860-f5b1deaf1fc8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:46.111460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8f77f8db-0f46-4e14-8860-f5b1deaf1fc8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:46.117956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f77f8db-0f46-4e14-8860-f5b1deaf1fc8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.118690 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f77f8db-0f46-4e14-8860-f5b1deaf1fc8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.119665 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f77f8db-0f46-4e14-8860-f5b1deaf1fc8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.120109 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f77f8db-0f46-4e14-8860-f5b1deaf1fc8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.120213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8f344b6f-2a1e-4523-bb88-541b49b718a0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:46.121404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8f344b6f-2a1e-4523-bb88-541b49b718a0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:46.128141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f344b6f-2a1e-4523-bb88-541b49b718a0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.128617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f344b6f-2a1e-4523-bb88-541b49b718a0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.129402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f344b6f-2a1e-4523-bb88-541b49b718a0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.130014 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f344b6f-2a1e-4523-bb88-541b49b718a0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.336037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8f344b6f-2a1e-4523-bb88-541b49b718a0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28364 microversion: 2.1 time: 0.219382 Jan 27 16:05:46.343113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 286/568] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:46 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:46.343113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:46.343113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:46.344388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8f77f8db-0f46-4e14-8860-f5b1deaf1fc8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28641 microversion: 2.20 time: 0.237948 Jan 27 16:05:46.345665 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 283/569] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:46 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28641 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:46.352315 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.352768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.353647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.354082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.516619 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:46.524377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0d8fe417-2646-47b6-8957-4289555e7e67 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.186558 Jan 27 16:05:46.525166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 287/570] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:46 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:46.611317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:46.612160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:46.622233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.623047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.623959 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:46.624567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:46.767273 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:46.775087 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bbc49563-83a0-4b5e-96ec-08b93dac8ed7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1508 microversion: 2.1 time: 0.168843 Jan 27 16:05:46.775815 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 284/571] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:46 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:47.348499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f76b13e7-25fe-4717-a211-5123e78de36d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:47.349496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f76b13e7-25fe-4717-a211-5123e78de36d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:47.364274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9f8c4e4f-3601-4cd3-b4bd-566d3b6baa99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:47.365296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9f8c4e4f-3601-4cd3-b4bd-566d3b6baa99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:47.376697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f8c4e4f-3601-4cd3-b4bd-566d3b6baa99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.380990 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f76b13e7-25fe-4717-a211-5123e78de36d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.381277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f8c4e4f-3601-4cd3-b4bd-566d3b6baa99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.381277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f8c4e4f-3601-4cd3-b4bd-566d3b6baa99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.381277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f8c4e4f-3601-4cd3-b4bd-566d3b6baa99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.381497 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f76b13e7-25fe-4717-a211-5123e78de36d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.392818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f76b13e7-25fe-4717-a211-5123e78de36d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.393602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f76b13e7-25fe-4717-a211-5123e78de36d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.612412 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f76b13e7-25fe-4717-a211-5123e78de36d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28364 microversion: 2.1 time: 0.266980 Jan 27 16:05:47.613074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 288/572] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:47 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:47.621853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:47.623713 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:47.642236 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.643190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.644251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.644951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.691503 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9f8c4e4f-3601-4cd3-b4bd-566d3b6baa99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.338971 Jan 27 16:05:47.692894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 285/573] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:47 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:47.795338 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:47.796573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:47.805163 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.805999 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.806966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:47.807611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:47.866661 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:47.876319 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d50d2751-9472-4915-aed0-e7d3d8645b79 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.261728 Jan 27 16:05:47.876790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 289/574] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:47 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:48.008864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:48.015233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dbf00ba2-5fd0-43d8-b0e9-8b322dbbca08 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1508 microversion: 2.1 time: 0.225805 Jan 27 16:05:48.026296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 286/575] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:47 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:48.625219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-465f8592-8c48-4ff3-903f-efeee732ffde tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:48.627567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-465f8592-8c48-4ff3-903f-efeee732ffde tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:48.634862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-465f8592-8c48-4ff3-903f-efeee732ffde tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:48.635442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-465f8592-8c48-4ff3-903f-efeee732ffde tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:48.636595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-465f8592-8c48-4ff3-903f-efeee732ffde tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:48.637255 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-465f8592-8c48-4ff3-903f-efeee732ffde tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:48.704153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-06a5371b-8e56-46b9-a730-05b3bf86e3f7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:48.705073 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-06a5371b-8e56-46b9-a730-05b3bf86e3f7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:48.711990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06a5371b-8e56-46b9-a730-05b3bf86e3f7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:48.712947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06a5371b-8e56-46b9-a730-05b3bf86e3f7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:48.714184 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06a5371b-8e56-46b9-a730-05b3bf86e3f7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:48.714629 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-06a5371b-8e56-46b9-a730-05b3bf86e3f7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:48.948272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-465f8592-8c48-4ff3-903f-efeee732ffde tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.327747 Jan 27 16:05:48.952431 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 290/576] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:48 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:48.953140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-06a5371b-8e56-46b9-a730-05b3bf86e3f7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.253237 Jan 27 16:05:48.954367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 287/577] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:48 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:48.956630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:48.957407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:48.964519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:48.965067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:48.966646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:48.967154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:49.036271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:49.038349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:49.053871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:49.054467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:49.055647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:49.056564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:49.143359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:49.148879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d019ebd4-5841-4e90-a3f5-a1641c01ba77 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.197476 Jan 27 16:05:49.149527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 291/578] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:48 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:49.218467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:49.226106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-36f8b26b-e38e-4bdf-a4eb-6de0289afa2a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1508 microversion: 2.1 time: 0.197698 Jan 27 16:05:49.226669 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 288/579] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:49 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:49.960279 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-902e3178-9138-4381-8d68-fa91b3aee95f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:49.961851 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-902e3178-9138-4381-8d68-fa91b3aee95f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:49.965945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2ab54a9b-afa8-40b6-8e83-ed5959e172cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:49.967583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2ab54a9b-afa8-40b6-8e83-ed5959e172cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:49.969797 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-902e3178-9138-4381-8d68-fa91b3aee95f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:49.970480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-902e3178-9138-4381-8d68-fa91b3aee95f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:49.971664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-902e3178-9138-4381-8d68-fa91b3aee95f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:49.972593 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-902e3178-9138-4381-8d68-fa91b3aee95f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:49.975088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2ab54a9b-afa8-40b6-8e83-ed5959e172cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:49.976007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2ab54a9b-afa8-40b6-8e83-ed5959e172cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:49.977017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2ab54a9b-afa8-40b6-8e83-ed5959e172cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:49.977610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2ab54a9b-afa8-40b6-8e83-ed5959e172cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:52.772118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-902e3178-9138-4381-8d68-fa91b3aee95f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 2.815821 Jan 27 16:05:52.772778 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 292/580] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:49 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 2817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:52.777835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:52.777990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2ab54a9b-afa8-40b6-8e83-ed5959e172cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 2.815993 Jan 27 16:05:52.779080 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:52.780030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 289/581] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:49 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:05:52.786055 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:52.786251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:52.786594 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:52.787151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:52.787427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:52.787865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:52.795389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:52.795932 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:52.796800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:52.797479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:52.948970 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:52.953348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:52.956632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f3c83b3b-2440-42c3-a834-507e3bf4ee97 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.182471 Jan 27 16:05:52.957216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 293/582] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:52 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:52.960893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-516fc6b7-a833-4e3b-bad3-9183bf8a3b8c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1508 microversion: 2.1 time: 0.179020 Jan 27 16:05:52.961529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 290/583] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:52 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:53.783564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-aed899e9-9056-4400-a9fb-6cb2fbce9e71 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:53.784483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-aed899e9-9056-4400-a9fb-6cb2fbce9e71 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:53.790960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aed899e9-9056-4400-a9fb-6cb2fbce9e71 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:53.791279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0b5fc234-b1d6-4d4f-8dc3-73fbda0644f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:53.791723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aed899e9-9056-4400-a9fb-6cb2fbce9e71 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:53.792184 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0b5fc234-b1d6-4d4f-8dc3-73fbda0644f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:53.792289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aed899e9-9056-4400-a9fb-6cb2fbce9e71 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:53.792645 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aed899e9-9056-4400-a9fb-6cb2fbce9e71 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:53.799207 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5fc234-b1d6-4d4f-8dc3-73fbda0644f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:53.799653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5fc234-b1d6-4d4f-8dc3-73fbda0644f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:53.800434 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5fc234-b1d6-4d4f-8dc3-73fbda0644f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:53.800869 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b5fc234-b1d6-4d4f-8dc3-73fbda0644f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:53.985834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-aed899e9-9056-4400-a9fb-6cb2fbce9e71 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.205640 Jan 27 16:05:53.986396 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 294/584] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:53 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:53.991418 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:53.992113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:53.999992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:54.000447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:54.001245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:54.001683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:54.012480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0b5fc234-b1d6-4d4f-8dc3-73fbda0644f9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.224613 Jan 27 16:05:54.013886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 291/585] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:53 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:54.019197 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:54.020135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:54.027296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:54.028001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:54.029113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:54.029705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:54.184340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:54.193606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b4f2e57b-7c71-4dc4-a93c-8aa8fed3f120 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.205769 Jan 27 16:05:54.194316 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 295/586] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:53 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:54.314849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:54.322382 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ef729bbd-2b63-439c-a0e7-167c95cd99bc tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1508 microversion: 2.1 time: 0.307260 Jan 27 16:05:54.323400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 292/587] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:54 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:54.997394 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c88b8f40-098e-445e-a931-79e857f70f17 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:54.998314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c88b8f40-098e-445e-a931-79e857f70f17 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:55.004748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c88b8f40-098e-445e-a931-79e857f70f17 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.005198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c88b8f40-098e-445e-a931-79e857f70f17 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.006065 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c88b8f40-098e-445e-a931-79e857f70f17 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.006507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c88b8f40-098e-445e-a931-79e857f70f17 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.024596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-42817ad1-0252-4bdd-8e63-be1992624e4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:55.025515 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-42817ad1-0252-4bdd-8e63-be1992624e4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:55.032323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42817ad1-0252-4bdd-8e63-be1992624e4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.032775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42817ad1-0252-4bdd-8e63-be1992624e4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.033586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42817ad1-0252-4bdd-8e63-be1992624e4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.034023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42817ad1-0252-4bdd-8e63-be1992624e4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.070559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c88b8f40-098e-445e-a931-79e857f70f17 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.076919 Jan 27 16:05:55.071140 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 296/588] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:54 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:05:55.112746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-42817ad1-0252-4bdd-8e63-be1992624e4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.091688 Jan 27 16:05:55.113429 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 293/589] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:55 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:55.210676 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:55.211386 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:55.218787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.219257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.220044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.220480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.340381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:55.341708 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:55.348625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.349080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.349875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:55.350315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:55.361048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:55.367804 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a588c5fa-c2a1-46d0-9017-5962acb04ea4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.161007 Jan 27 16:05:55.368750 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 297/590] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:55 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:55.487935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:55.495784 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3a91fe5e-c945-4c01-994d-d24ee34ecddb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1514 microversion: 2.1 time: 0.159338 Jan 27 16:05:55.496429 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 294/591] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:55 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:05:56.082278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2f566783-c468-42fc-ae9e-030f5ef78511 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:56.083229 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2f566783-c468-42fc-ae9e-030f5ef78511 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:56.089813 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2f566783-c468-42fc-ae9e-030f5ef78511 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:56.090264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2f566783-c468-42fc-ae9e-030f5ef78511 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:56.091726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2f566783-c468-42fc-ae9e-030f5ef78511 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:56.092160 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2f566783-c468-42fc-ae9e-030f5ef78511 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:56.124757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-43c115dd-6d32-420c-9bf4-5a30b13e9e45 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:56.125684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-43c115dd-6d32-420c-9bf4-5a30b13e9e45 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:56.132319 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-43c115dd-6d32-420c-9bf4-5a30b13e9e45 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:56.132773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-43c115dd-6d32-420c-9bf4-5a30b13e9e45 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:56.133572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-43c115dd-6d32-420c-9bf4-5a30b13e9e45 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:56.134015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-43c115dd-6d32-420c-9bf4-5a30b13e9e45 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:56.162350 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2f566783-c468-42fc-ae9e-030f5ef78511 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.083773 Jan 27 16:05:56.163009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 298/592] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:56 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:05:56.219467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-43c115dd-6d32-420c-9bf4-5a30b13e9e45 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.098187 Jan 27 16:05:56.220096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 295/593] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:56 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:05:56.385316 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:05:56.386011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:56.393371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:56.393821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:56.394602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:56.395063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:56.523690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:05:56.531418 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e22f3f38-98a9-4365-955a-599283bea373 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.150108 Jan 27 16:05:56.531983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 299/594] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:05:56 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:05:57.174594 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eb7b36e0-5fcf-4ec1-99a9-af31e6d73b94 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:57.175545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-eb7b36e0-5fcf-4ec1-99a9-af31e6d73b94 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:57.182353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb7b36e0-5fcf-4ec1-99a9-af31e6d73b94 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:57.182800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb7b36e0-5fcf-4ec1-99a9-af31e6d73b94 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:57.183591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb7b36e0-5fcf-4ec1-99a9-af31e6d73b94 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:57.184023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb7b36e0-5fcf-4ec1-99a9-af31e6d73b94 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:57.230011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-520aca86-81e6-4922-bb53-4d86ca78c3da tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:05:57.230958 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-520aca86-81e6-4922-bb53-4d86ca78c3da tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:05:57.237309 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-520aca86-81e6-4922-bb53-4d86ca78c3da tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:57.237767 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-520aca86-81e6-4922-bb53-4d86ca78c3da tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:05:57.238584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-520aca86-81e6-4922-bb53-4d86ca78c3da tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:05:57.239041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-520aca86-81e6-4922-bb53-4d86ca78c3da tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:00.632709 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-520aca86-81e6-4922-bb53-4d86ca78c3da tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 3.406214 Jan 27 16:06:00.636757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 300/595] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:05:57 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 3408 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:00.638576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:00.639287 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:00.642367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eb7b36e0-5fcf-4ec1-99a9-af31e6d73b94 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 3.471711 Jan 27 16:06:00.643053 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 296/596] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:05:57 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 3473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:00.646409 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:00.646850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:00.647659 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:00.648089 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:00.651662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-29deba3d-5f3b-45f2-a068-53e2fb085e30 req-bddf2d93-3ee8-47ab-954e-b66f95a70111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402", "name": "network-vif-plugged", "status": "completed", "tag": "24367130-5983-4920-adec-cf550eaa56f4"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:00.653310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:06:00.653310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:06:00.662398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-29deba3d-5f3b-45f2-a068-53e2fb085e30 req-bddf2d93-3ee8-47ab-954e-b66f95a70111 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:00.662830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-29deba3d-5f3b-45f2-a068-53e2fb085e30 req-bddf2d93-3ee8-47ab-954e-b66f95a70111 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:00.674372 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-29deba3d-5f3b-45f2-a068-53e2fb085e30 req-bddf2d93-3ee8-47ab-954e-b66f95a70111 service nova] Creating event network-vif-plugged:24367130-5983-4920-adec-cf550eaa56f4 for instance a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 on hv-cinder-82635 Jan 27 16:06:00.679198 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-29deba3d-5f3b-45f2-a068-53e2fb085e30 req-bddf2d93-3ee8-47ab-954e-b66f95a70111 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031672 Jan 27 16:06:00.679804 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 297/597] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:06:00.784667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:00.792356 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fd9b5448-26de-44c9-bd0b-cc142a1d163a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.157479 Jan 27 16:06:00.792936 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 301/598] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:00 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:01.645181 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0bca07ad-0ad6-4d22-bd45-b9a8e300c7ea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:01.646196 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0bca07ad-0ad6-4d22-bd45-b9a8e300c7ea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:01.653775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bca07ad-0ad6-4d22-bd45-b9a8e300c7ea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:01.654218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bca07ad-0ad6-4d22-bd45-b9a8e300c7ea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:01.654489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bb46cd99-05ec-48c3-ab97-ad3068309205 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:01.655016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bca07ad-0ad6-4d22-bd45-b9a8e300c7ea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:01.655428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bb46cd99-05ec-48c3-ab97-ad3068309205 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:01.655526 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bca07ad-0ad6-4d22-bd45-b9a8e300c7ea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:01.663251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb46cd99-05ec-48c3-ab97-ad3068309205 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:01.663699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb46cd99-05ec-48c3-ab97-ad3068309205 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:01.664492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb46cd99-05ec-48c3-ab97-ad3068309205 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:01.664932 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb46cd99-05ec-48c3-ab97-ad3068309205 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:01.962561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0bca07ad-0ad6-4d22-bd45-b9a8e300c7ea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.321678 Jan 27 16:06:01.963240 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 298/599] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:01 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:01.968894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:01.969583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:01.976497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:01.976945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:01.977729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:01.978165 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:01.987609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bb46cd99-05ec-48c3-ab97-ad3068309205 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.337510 Jan 27 16:06:01.991040 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 302/600] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:01 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:02.129800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:02.137786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-52b16fa2-10c5-42da-b67d-2f06711bb6eb tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.172847 Jan 27 16:06:02.138458 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 299/601] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:01 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:02.975219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e0e798eb-cbf9-4fb5-96f7-fecd763f8e5e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:02.976226 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e0e798eb-cbf9-4fb5-96f7-fecd763f8e5e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:02.984435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0e798eb-cbf9-4fb5-96f7-fecd763f8e5e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:02.984888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0e798eb-cbf9-4fb5-96f7-fecd763f8e5e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:02.985696 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0e798eb-cbf9-4fb5-96f7-fecd763f8e5e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:02.986133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0e798eb-cbf9-4fb5-96f7-fecd763f8e5e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:03.000081 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3684138b-3e7e-416e-8789-55a7e6f7ba35 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:03.001082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3684138b-3e7e-416e-8789-55a7e6f7ba35 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:03.007311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3684138b-3e7e-416e-8789-55a7e6f7ba35 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:03.007827 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3684138b-3e7e-416e-8789-55a7e6f7ba35 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:03.008667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3684138b-3e7e-416e-8789-55a7e6f7ba35 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:03.009100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3684138b-3e7e-416e-8789-55a7e6f7ba35 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:07.111058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3684138b-3e7e-416e-8789-55a7e6f7ba35 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 4.115003 Jan 27 16:06:07.111763 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 300/602] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:02 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 4117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:07.115676 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e0e798eb-cbf9-4fb5-96f7-fecd763f8e5e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 4.144255 Jan 27 16:06:07.120190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 303/603] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:02 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 4147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:07.122662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:07.123396 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:07.130474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:07.130966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:07.131801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:07.132501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:07.260541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:07.268199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-928ae6b7-ffe2-492e-b4c2-f571a447506e tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.149736 Jan 27 16:06:07.268761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 301/604] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:07 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:08.123285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2d90af3a-ca96-42d5-a7ef-70679e0e7fcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:08.124325 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d90af3a-ca96-42d5-a7ef-70679e0e7fcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:08.127227 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a4427f81-0f52-4fbe-87c1-a55c977cdec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:08.128133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a4427f81-0f52-4fbe-87c1-a55c977cdec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:08.132052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d90af3a-ca96-42d5-a7ef-70679e0e7fcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:08.132507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d90af3a-ca96-42d5-a7ef-70679e0e7fcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:08.133309 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d90af3a-ca96-42d5-a7ef-70679e0e7fcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:08.133748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d90af3a-ca96-42d5-a7ef-70679e0e7fcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:08.134432 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4427f81-0f52-4fbe-87c1-a55c977cdec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:08.134886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4427f81-0f52-4fbe-87c1-a55c977cdec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:08.135703 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4427f81-0f52-4fbe-87c1-a55c977cdec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:08.136302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4427f81-0f52-4fbe-87c1-a55c977cdec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:08.226894 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2d90af3a-ca96-42d5-a7ef-70679e0e7fcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.107727 Jan 27 16:06:08.227720 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 304/605] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:08 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:08.229185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a4427f81-0f52-4fbe-87c1-a55c977cdec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.105633 Jan 27 16:06:08.230008 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 302/606] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:08 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:08.285666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:08.286359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:08.293223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:08.293674 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:08.294458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:08.294892 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:08.436110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:08.443807 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d364cdc1-b49d-44c7-804a-cb9c2d95aa3f tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1317 microversion: 2.1 time: 0.162134 Jan 27 16:06:08.444622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 305/607] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:08 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:09.237929 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dafc134f-fece-4df6-861b-2d0890c28658 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:09.238937 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dafc134f-fece-4df6-861b-2d0890c28658 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:09.240469 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e328902e-dcff-40fe-a48c-0f28eb6806cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:09.241440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e328902e-dcff-40fe-a48c-0f28eb6806cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:09.246479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dafc134f-fece-4df6-861b-2d0890c28658 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.247156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dafc134f-fece-4df6-861b-2d0890c28658 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.248113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dafc134f-fece-4df6-861b-2d0890c28658 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.248561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dafc134f-fece-4df6-861b-2d0890c28658 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.249363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e328902e-dcff-40fe-a48c-0f28eb6806cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.249817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e328902e-dcff-40fe-a48c-0f28eb6806cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.250688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e328902e-dcff-40fe-a48c-0f28eb6806cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.251343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e328902e-dcff-40fe-a48c-0f28eb6806cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.335691 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dafc134f-fece-4df6-861b-2d0890c28658 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.101499 Jan 27 16:06:09.337240 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 303/608] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:09 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:09.351453 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e328902e-dcff-40fe-a48c-0f28eb6806cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.114491 Jan 27 16:06:09.352142 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 306/609] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:09 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:09.416323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:09.417031 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:09.424400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.424857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.425657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.426100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.461092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:09.461795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:09.469486 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.469938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.470744 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.471221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.565378 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:09.572839 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e2ae4e3f-18f6-4888-8540-d0493b740e93 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1514 microversion: 2.1 time: 0.160629 Jan 27 16:06:09.573416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 304/610] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:09 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:09.588464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6e44673d-659e-4a9c-8b98-79198c8506d9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "681d4538-9943-450a-89bb-a4846613a3fb"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:09.589521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6e44673d-659e-4a9c-8b98-79198c8506d9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:09.595290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e44673d-659e-4a9c-8b98-79198c8506d9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.595744 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e44673d-659e-4a9c-8b98-79198c8506d9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.596533 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e44673d-659e-4a9c-8b98-79198c8506d9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:09.596972 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e44673d-659e-4a9c-8b98-79198c8506d9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:09.602250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:09.610454 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8c227c93-e914-4670-ac80-1dd8b94ff2f8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1507 microversion: 2.1 time: 0.153602 Jan 27 16:06:09.611054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 307/611] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:09 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:09.854183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6e44673d-659e-4a9c-8b98-79198c8506d9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269118 Jan 27 16:06:09.854790 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 305/612] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:06:09 2022] POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:06:10.352225 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dcc5b6ce-ea2f-41e0-8362-9dacfa261fcf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:10.353905 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dcc5b6ce-ea2f-41e0-8362-9dacfa261fcf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:10.373279 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcc5b6ce-ea2f-41e0-8362-9dacfa261fcf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:10.373735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcc5b6ce-ea2f-41e0-8362-9dacfa261fcf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:10.374519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcc5b6ce-ea2f-41e0-8362-9dacfa261fcf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:10.374954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcc5b6ce-ea2f-41e0-8362-9dacfa261fcf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:10.378969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-07458f4f-676d-4315-9945-22a241bad531 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:10.380045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-07458f4f-676d-4315-9945-22a241bad531 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:10.395603 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-07458f4f-676d-4315-9945-22a241bad531 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:10.396233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-07458f4f-676d-4315-9945-22a241bad531 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:10.397183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-07458f4f-676d-4315-9945-22a241bad531 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:10.397616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-07458f4f-676d-4315-9945-22a241bad531 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:10.474550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dcc5b6ce-ea2f-41e0-8362-9dacfa261fcf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.130411 Jan 27 16:06:10.479019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 308/613] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:10 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:10.484915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-07458f4f-676d-4315-9945-22a241bad531 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.125659 Jan 27 16:06:10.488889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 306/614] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:10 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:11.487363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8df95fa7-3c03-4d1c-a800-9ec2e39ab32a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:11.488562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8df95fa7-3c03-4d1c-a800-9ec2e39ab32a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:11.501834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8df95fa7-3c03-4d1c-a800-9ec2e39ab32a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:11.502665 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8df95fa7-3c03-4d1c-a800-9ec2e39ab32a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:11.503259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b1872483-0b93-4b68-ad2c-dab5239ddd29 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:11.504425 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8df95fa7-3c03-4d1c-a800-9ec2e39ab32a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:11.504559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b1872483-0b93-4b68-ad2c-dab5239ddd29 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:11.506208 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8df95fa7-3c03-4d1c-a800-9ec2e39ab32a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:11.512618 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1872483-0b93-4b68-ad2c-dab5239ddd29 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:11.513064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1872483-0b93-4b68-ad2c-dab5239ddd29 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:11.514440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1872483-0b93-4b68-ad2c-dab5239ddd29 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:11.515099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1872483-0b93-4b68-ad2c-dab5239ddd29 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:11.601213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8df95fa7-3c03-4d1c-a800-9ec2e39ab32a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.118011 Jan 27 16:06:11.602923 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 309/615] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:11 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:11.616540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b1872483-0b93-4b68-ad2c-dab5239ddd29 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.121880 Jan 27 16:06:11.617961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 307/616] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:11 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:11.996442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4cc53342-d555-4667-a360-25c8b78c2856 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7a8cbbb-042f-4acd-9df8-632caf92c3f2"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:11.997824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4cc53342-d555-4667-a360-25c8b78c2856 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:12.004999 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cc53342-d555-4667-a360-25c8b78c2856 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:12.006227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cc53342-d555-4667-a360-25c8b78c2856 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:12.007270 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cc53342-d555-4667-a360-25c8b78c2856 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:12.007774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cc53342-d555-4667-a360-25c8b78c2856 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:12.290361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4cc53342-d555-4667-a360-25c8b78c2856 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "POST /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298525 Jan 27 16:06:12.302920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 310/617] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:06:11 2022] POST /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:06:12.616955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-32e43309-3745-44a2-80ce-2d61dd91a964 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:12.618858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-32e43309-3745-44a2-80ce-2d61dd91a964 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:12.627887 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-32e43309-3745-44a2-80ce-2d61dd91a964 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:12.628383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-32e43309-3745-44a2-80ce-2d61dd91a964 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:12.629625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-32e43309-3745-44a2-80ce-2d61dd91a964 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:12.630069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-32e43309-3745-44a2-80ce-2d61dd91a964 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:12.630949 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5950af23-9e03-4a41-b96f-302c05c9c886 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:12.633344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5950af23-9e03-4a41-b96f-302c05c9c886 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:12.644694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5950af23-9e03-4a41-b96f-302c05c9c886 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:12.647175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5950af23-9e03-4a41-b96f-302c05c9c886 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:12.649789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5950af23-9e03-4a41-b96f-302c05c9c886 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:12.650246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5950af23-9e03-4a41-b96f-302c05c9c886 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:12.708805 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-32e43309-3745-44a2-80ce-2d61dd91a964 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.098393 Jan 27 16:06:12.710915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 308/618] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:12 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:12.760979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5950af23-9e03-4a41-b96f-302c05c9c886 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.134722 Jan 27 16:06:12.762967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 311/619] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:12 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:13.721857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-52689869-9058-44b6-b1b1-6f155cab9894 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:13.722753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-52689869-9058-44b6-b1b1-6f155cab9894 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:13.729549 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52689869-9058-44b6-b1b1-6f155cab9894 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:13.729991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52689869-9058-44b6-b1b1-6f155cab9894 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:13.730762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52689869-9058-44b6-b1b1-6f155cab9894 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:13.731222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-52689869-9058-44b6-b1b1-6f155cab9894 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:13.774139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0256b713-03bd-4e80-a165-d00b5060ae4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:13.775161 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0256b713-03bd-4e80-a165-d00b5060ae4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:13.782189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0256b713-03bd-4e80-a165-d00b5060ae4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:13.782640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0256b713-03bd-4e80-a165-d00b5060ae4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:13.783648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0256b713-03bd-4e80-a165-d00b5060ae4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:13.783919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0256b713-03bd-4e80-a165-d00b5060ae4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:13.797168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-52689869-9058-44b6-b1b1-6f155cab9894 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.079274 Jan 27 16:06:13.798053 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 309/620] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:13 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:13.869806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0256b713-03bd-4e80-a165-d00b5060ae4e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.099273 Jan 27 16:06:13.871099 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 312/621] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:13 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:14.808492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-010e2905-d936-4192-aea9-e2a2e4578080 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:14.809596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-010e2905-d936-4192-aea9-e2a2e4578080 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:14.816884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-010e2905-d936-4192-aea9-e2a2e4578080 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:14.817545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-010e2905-d936-4192-aea9-e2a2e4578080 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:14.818536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-010e2905-d936-4192-aea9-e2a2e4578080 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:14.818893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-010e2905-d936-4192-aea9-e2a2e4578080 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:14.882234 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d44e7cc6-04b6-4c9a-81c4-0565d9c4db5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:14.883527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d44e7cc6-04b6-4c9a-81c4-0565d9c4db5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:14.890102 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-010e2905-d936-4192-aea9-e2a2e4578080 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.085541 Jan 27 16:06:14.891073 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 310/622] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:14 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:14.891264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d44e7cc6-04b6-4c9a-81c4-0565d9c4db5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:14.891899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d44e7cc6-04b6-4c9a-81c4-0565d9c4db5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:14.892968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d44e7cc6-04b6-4c9a-81c4-0565d9c4db5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:14.893654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d44e7cc6-04b6-4c9a-81c4-0565d9c4db5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:14.962886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d44e7cc6-04b6-4c9a-81c4-0565d9c4db5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.084460 Jan 27 16:06:14.963820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 313/623] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:14 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:15.903233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f6095dc5-8758-485d-9812-1b282b2c9973 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:15.904563 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f6095dc5-8758-485d-9812-1b282b2c9973 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:15.911307 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6095dc5-8758-485d-9812-1b282b2c9973 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:15.911757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6095dc5-8758-485d-9812-1b282b2c9973 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:15.912636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6095dc5-8758-485d-9812-1b282b2c9973 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:15.913082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6095dc5-8758-485d-9812-1b282b2c9973 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:15.975357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9096bd51-2070-4596-9a48-a1f5cbe79149 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:15.976460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9096bd51-2070-4596-9a48-a1f5cbe79149 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:15.979863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f6095dc5-8758-485d-9812-1b282b2c9973 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.081176 Jan 27 16:06:15.984384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 311/624] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:15 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:15.984540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9096bd51-2070-4596-9a48-a1f5cbe79149 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:15.984754 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9096bd51-2070-4596-9a48-a1f5cbe79149 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:15.985549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9096bd51-2070-4596-9a48-a1f5cbe79149 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:15.986020 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9096bd51-2070-4596-9a48-a1f5cbe79149 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:16.065658 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9096bd51-2070-4596-9a48-a1f5cbe79149 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.094137 Jan 27 16:06:16.066594 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 314/625] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:15 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:16.992699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-af341019-3603-4be7-8931-511c28cb9d28 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:16.993640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-af341019-3603-4be7-8931-511c28cb9d28 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:17.000998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af341019-3603-4be7-8931-511c28cb9d28 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:17.001448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af341019-3603-4be7-8931-511c28cb9d28 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:17.002259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af341019-3603-4be7-8931-511c28cb9d28 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:17.002695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af341019-3603-4be7-8931-511c28cb9d28 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:17.071878 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-af341019-3603-4be7-8931-511c28cb9d28 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.083228 Jan 27 16:06:17.076340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 312/626] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:16 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:17.078088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6484e1ac-f4fe-4713-a242-47643a376761 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:17.079117 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6484e1ac-f4fe-4713-a242-47643a376761 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:17.085971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6484e1ac-f4fe-4713-a242-47643a376761 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:17.086420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6484e1ac-f4fe-4713-a242-47643a376761 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:17.087240 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6484e1ac-f4fe-4713-a242-47643a376761 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:17.087683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6484e1ac-f4fe-4713-a242-47643a376761 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:17.171442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6484e1ac-f4fe-4713-a242-47643a376761 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.097665 Jan 27 16:06:17.172092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 315/627] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:17 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:18.084666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ee985eb5-c89e-4ceb-a675-97c6ddbf99b4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:18.085751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ee985eb5-c89e-4ceb-a675-97c6ddbf99b4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:18.093066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee985eb5-c89e-4ceb-a675-97c6ddbf99b4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:18.093592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee985eb5-c89e-4ceb-a675-97c6ddbf99b4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:18.094455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee985eb5-c89e-4ceb-a675-97c6ddbf99b4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:18.094965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ee985eb5-c89e-4ceb-a675-97c6ddbf99b4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:18.171662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ee985eb5-c89e-4ceb-a675-97c6ddbf99b4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.091004 Jan 27 16:06:18.172880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 313/628] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:18 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:18.183545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2b28f9b1-9269-4f0b-8b67-163e6b776af1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:18.184590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2b28f9b1-9269-4f0b-8b67-163e6b776af1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:18.191717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b28f9b1-9269-4f0b-8b67-163e6b776af1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:18.192157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b28f9b1-9269-4f0b-8b67-163e6b776af1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:18.192939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b28f9b1-9269-4f0b-8b67-163e6b776af1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:18.193371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b28f9b1-9269-4f0b-8b67-163e6b776af1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:18.293166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2b28f9b1-9269-4f0b-8b67-163e6b776af1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.112952 Jan 27 16:06:18.293806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 316/629] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:18 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:19.184765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-94645d50-9547-47b1-9423-7fbf2fb053f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:19.185782 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-94645d50-9547-47b1-9423-7fbf2fb053f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:19.192701 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94645d50-9547-47b1-9423-7fbf2fb053f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.193135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94645d50-9547-47b1-9423-7fbf2fb053f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.193930 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94645d50-9547-47b1-9423-7fbf2fb053f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.194371 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94645d50-9547-47b1-9423-7fbf2fb053f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.265084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-94645d50-9547-47b1-9423-7fbf2fb053f3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.084751 Jan 27 16:06:19.265793 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 314/630] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:19 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:19.304940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-80a76a10-0c96-4b66-9ffe-3ca4d0c9d296 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:19.305942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-80a76a10-0c96-4b66-9ffe-3ca4d0c9d296 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:19.313387 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80a76a10-0c96-4b66-9ffe-3ca4d0c9d296 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.313837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80a76a10-0c96-4b66-9ffe-3ca4d0c9d296 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.314667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80a76a10-0c96-4b66-9ffe-3ca4d0c9d296 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.315101 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80a76a10-0c96-4b66-9ffe-3ca4d0c9d296 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.382079 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-80a76a10-0c96-4b66-9ffe-3ca4d0c9d296 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.080941 Jan 27 16:06:19.385949 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 317/631] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:19 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:19.533210 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:19.534221 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:19.541349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.541799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.543128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.543559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.568524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lazy-loading 'flavor' on Instance uuid e56702b3-830c-441b-b790-b13f42d20c0d {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:06:19.693263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-08ca92d1-a83c-43a8-a577-d78544c0caea tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action" status: 200 len: 32 microversion: 2.1 time: 0.164380 Jan 27 16:06:19.694065 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 315/632] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:19 2022] POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:06:19.703666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:19.704445 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:19.711580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.712135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.713029 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:19.713536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:19.850104 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:19.859129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-74658898-c243-4395-a349-78956352e4de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.159517 Jan 27 16:06:19.859707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 318/633] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:19 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:20.278293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-55ba5698-c0a6-4eed-9e99-6c5bed9f0e55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:20.279303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-55ba5698-c0a6-4eed-9e99-6c5bed9f0e55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:20.290352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55ba5698-c0a6-4eed-9e99-6c5bed9f0e55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:20.291047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55ba5698-c0a6-4eed-9e99-6c5bed9f0e55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:20.292501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55ba5698-c0a6-4eed-9e99-6c5bed9f0e55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:20.293290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55ba5698-c0a6-4eed-9e99-6c5bed9f0e55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:20.392914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c4963310-b620-4999-8d60-8b5a8877b271 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:20.393829 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c4963310-b620-4999-8d60-8b5a8877b271 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:20.400100 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4963310-b620-4999-8d60-8b5a8877b271 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:20.400579 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4963310-b620-4999-8d60-8b5a8877b271 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:20.402014 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4963310-b620-4999-8d60-8b5a8877b271 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:20.402452 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4963310-b620-4999-8d60-8b5a8877b271 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:21.755285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:06:21.755752 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action (ip 10.222.0.61) !!! Jan 27 16:06:23.781076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-55ba5698-c0a6-4eed-9e99-6c5bed9f0e55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 3.507833 Jan 27 16:06:23.785049 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 316/634] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:20 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 3510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:23.787694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c4963310-b620-4999-8d60-8b5a8877b271 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 3.398291 Jan 27 16:06:23.788185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:23.788834 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:23.789718 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 319/635] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:20 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 3401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:23.796313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:23.796756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:23.797535 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:23.797963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:23.927199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:23.935435 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-73bd8c77-5bdd-47a3-ad7d-256466601c90 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.152348 Jan 27 16:06:23.935984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 317/636] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:23 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:24.794200 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-db78f85d-f952-4193-807f-019af0ccbc3e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:24.795228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-db78f85d-f952-4193-807f-019af0ccbc3e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:24.800504 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0d5a008d-fd6c-4474-a50f-c1d4da9bdcfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:24.801546 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0d5a008d-fd6c-4474-a50f-c1d4da9bdcfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:24.802048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-db78f85d-f952-4193-807f-019af0ccbc3e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:24.802493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-db78f85d-f952-4193-807f-019af0ccbc3e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:24.803296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-db78f85d-f952-4193-807f-019af0ccbc3e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:24.803726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-db78f85d-f952-4193-807f-019af0ccbc3e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:24.808337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d5a008d-fd6c-4474-a50f-c1d4da9bdcfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:24.809492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d5a008d-fd6c-4474-a50f-c1d4da9bdcfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:24.810333 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d5a008d-fd6c-4474-a50f-c1d4da9bdcfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:24.810851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0d5a008d-fd6c-4474-a50f-c1d4da9bdcfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:25.004032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-db78f85d-f952-4193-807f-019af0ccbc3e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.214771 Jan 27 16:06:25.004894 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 320/637] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:24 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:25.009437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:25.010139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:25.017163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:25.017340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0d5a008d-fd6c-4474-a50f-c1d4da9bdcfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.220743 Jan 27 16:06:25.017609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:25.017837 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 318/638] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:24 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:25.018782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:25.019245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:25.154529 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:25.162342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-563c4993-bcec-4b11-9792-6a8062bd8676 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.156567 Jan 27 16:06:25.162917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 321/639] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:25 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:26.016606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ebdc37cc-421a-4747-b808-8756b74f66fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:26.017622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ebdc37cc-421a-4747-b808-8756b74f66fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:26.024951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ebdc37cc-421a-4747-b808-8756b74f66fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.025394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ebdc37cc-421a-4747-b808-8756b74f66fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.026342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ebdc37cc-421a-4747-b808-8756b74f66fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.026925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ebdc37cc-421a-4747-b808-8756b74f66fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.031360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d8f2c181-cfd1-4611-8f88-7a751186678f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:26.032452 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d8f2c181-cfd1-4611-8f88-7a751186678f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:26.040520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8f2c181-cfd1-4611-8f88-7a751186678f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.040966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8f2c181-cfd1-4611-8f88-7a751186678f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.042246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8f2c181-cfd1-4611-8f88-7a751186678f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.042791 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8f2c181-cfd1-4611-8f88-7a751186678f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.134007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ebdc37cc-421a-4747-b808-8756b74f66fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.121495 Jan 27 16:06:26.135212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 319/640] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:26 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:26.135357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d8f2c181-cfd1-4611-8f88-7a751186678f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.109627 Jan 27 16:06:26.135925 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 322/641] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:26 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:26.180281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:26.181076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:26.189096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.189575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.190410 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.190870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.207180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:26.207795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:26.215169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.215698 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.216548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.217260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.308458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lazy-loading 'services' on Instance uuid a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:06:26.352641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:26.363172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cbde216d-8029-494c-ba5e-2c67cb9af95e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.186879 Jan 27 16:06:26.364375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 320/642] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:26 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:26.381510 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0293845b-a16f-4b3b-b2d3-2db21b9c5548 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments/f7a8cbbb-042f-4acd-9df8-632caf92c3f2" status: 202 len: 0 microversion: 2.1 time: 0.178485 Jan 27 16:06:26.382083 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 323/643] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:06:26 2022] DELETE /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments/f7a8cbbb-042f-4acd-9df8-632caf92c3f2 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:26.390740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-64314950-df7f-4340-b5d0-d0637cb3875a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:26.391690 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-64314950-df7f-4340-b5d0-d0637cb3875a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:26.397801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64314950-df7f-4340-b5d0-d0637cb3875a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.398348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64314950-df7f-4340-b5d0-d0637cb3875a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.399416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64314950-df7f-4340-b5d0-d0637cb3875a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:26.400318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-64314950-df7f-4340-b5d0-d0637cb3875a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:26.432263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-64314950-df7f-4340-b5d0-d0637cb3875a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Jan 27 16:06:26.432739 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 321/644] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:06:26 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:06:27.147313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-365ccd68-5bbd-413d-a5f2-384f4d9f7e2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:27.148356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-365ccd68-5bbd-413d-a5f2-384f4d9f7e2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:27.148875 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-67240745-10ad-40cc-88d9-c0b764cd6577 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:27.150119 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-67240745-10ad-40cc-88d9-c0b764cd6577 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:27.155614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-365ccd68-5bbd-413d-a5f2-384f4d9f7e2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.156132 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-365ccd68-5bbd-413d-a5f2-384f4d9f7e2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.156984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-365ccd68-5bbd-413d-a5f2-384f4d9f7e2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.157574 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-365ccd68-5bbd-413d-a5f2-384f4d9f7e2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.157776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67240745-10ad-40cc-88d9-c0b764cd6577 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.158419 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67240745-10ad-40cc-88d9-c0b764cd6577 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.159239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67240745-10ad-40cc-88d9-c0b764cd6577 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.159683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67240745-10ad-40cc-88d9-c0b764cd6577 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.237209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-67240745-10ad-40cc-88d9-c0b764cd6577 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.093282 Jan 27 16:06:27.237881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 324/645] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:27 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:27.241439 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-365ccd68-5bbd-413d-a5f2-384f4d9f7e2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.098031 Jan 27 16:06:27.242064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 322/646] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:27 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:27.382002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:27.382779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:27.390385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.390836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.391653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.392095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.445585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-04a077a8-f4f7-47f9-8e9b-abefeff3d914 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:27.446567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-04a077a8-f4f7-47f9-8e9b-abefeff3d914 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:27.455506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a077a8-f4f7-47f9-8e9b-abefeff3d914 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.456063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a077a8-f4f7-47f9-8e9b-abefeff3d914 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.456897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a077a8-f4f7-47f9-8e9b-abefeff3d914 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:27.457333 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04a077a8-f4f7-47f9-8e9b-abefeff3d914 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:27.494592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-04a077a8-f4f7-47f9-8e9b-abefeff3d914 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053499 Jan 27 16:06:27.495506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 323/647] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:06:27 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:06:27.532702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:27.547163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-22f3bf87-98f4-4bba-8e3c-65f7b211f5e6 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.162659 Jan 27 16:06:27.547163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 325/648] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:27 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:28.249004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8b26e86c-ddc3-4d88-86ef-3241439646c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:28.249921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8b26e86c-ddc3-4d88-86ef-3241439646c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:28.252686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-06fb7be4-cdc3-40cd-a852-3de993ecc5a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:28.253611 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-06fb7be4-cdc3-40cd-a852-3de993ecc5a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:28.256301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8b26e86c-ddc3-4d88-86ef-3241439646c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.256769 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8b26e86c-ddc3-4d88-86ef-3241439646c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.257557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8b26e86c-ddc3-4d88-86ef-3241439646c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.258001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8b26e86c-ddc3-4d88-86ef-3241439646c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.259989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-06fb7be4-cdc3-40cd-a852-3de993ecc5a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.260443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-06fb7be4-cdc3-40cd-a852-3de993ecc5a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.261316 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-06fb7be4-cdc3-40cd-a852-3de993ecc5a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.262269 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-06fb7be4-cdc3-40cd-a852-3de993ecc5a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.335136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8b26e86c-ddc3-4d88-86ef-3241439646c9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.089979 Jan 27 16:06:28.335768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 324/649] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:28 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:28.345415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-06fb7be4-cdc3-40cd-a852-3de993ecc5a7 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.096035 Jan 27 16:06:28.346052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 326/650] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:28 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:28.558085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:28.558775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:28.565544 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.566000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.566792 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.567252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.698785 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:28.700082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:28.706876 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.707360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.708140 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.708571 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.720943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:28.730626 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e8bfbd3b-a9e9-4dca-b58e-507da90a8d5a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.176573 Jan 27 16:06:28.731145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 325/651] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:28 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:28.735758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:06:28.816613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3e43b105-e6a3-4cf7-9843-2a92e16e5d1a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 204 len: 0 microversion: 2.1 time: 0.121727 Jan 27 16:06:28.817616 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 327/652] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:06:28 2022] DELETE /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:06:28.826286 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:28.826887 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:28.833120 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.833562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.834332 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:28.834785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:28.961879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:28.969340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5eba21c0-f0fd-48b4-8d13-aa9aacb218f0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1513 microversion: 2.1 time: 0.147477 Jan 27 16:06:28.969955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 326/653] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:28 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:29.349161 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6a043367-05f1-467b-b560-ca4c1b5c0152 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:29.350156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6a043367-05f1-467b-b560-ca4c1b5c0152 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:29.357033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f8f52601-185b-44dc-8a21-1a5feef93077 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:29.357539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a043367-05f1-467b-b560-ca4c1b5c0152 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.357539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a043367-05f1-467b-b560-ca4c1b5c0152 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:29.358262 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a043367-05f1-467b-b560-ca4c1b5c0152 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.358694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6a043367-05f1-467b-b560-ca4c1b5c0152 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:29.358879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f8f52601-185b-44dc-8a21-1a5feef93077 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:29.365537 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8f52601-185b-44dc-8a21-1a5feef93077 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.365992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8f52601-185b-44dc-8a21-1a5feef93077 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:29.366817 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8f52601-185b-44dc-8a21-1a5feef93077 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.367290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8f52601-185b-44dc-8a21-1a5feef93077 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:29.439589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6a043367-05f1-467b-b560-ca4c1b5c0152 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.094280 Jan 27 16:06:29.440190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 328/654] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:29 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:29.450878 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f8f52601-185b-44dc-8a21-1a5feef93077 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.097888 Jan 27 16:06:29.451523 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 327/655] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:29 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:29.748139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:29.748824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:29.755607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.756063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:29.756822 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.757254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:29.898613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:29.907326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-112354e2-c554-4739-85fe-d740400a8f45 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.163377 Jan 27 16:06:29.917117 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 329/656] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:29 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:29.987560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:29.988268 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:29.995537 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.996564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:29.997353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:29.997789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:30.132564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:30.140204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d614fb39-776a-4930-ba4c-5f005e0d17b1 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1513 microversion: 2.1 time: 0.156559 Jan 27 16:06:30.140777 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 328/657] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:29 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:30.332219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:06:30.332437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:06:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:06:30.450522 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9215ec9c-da88-4fa9-b3d0-2ae0810c0d16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:30.451903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9215ec9c-da88-4fa9-b3d0-2ae0810c0d16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:30.459332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9215ec9c-da88-4fa9-b3d0-2ae0810c0d16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:30.459782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9215ec9c-da88-4fa9-b3d0-2ae0810c0d16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:30.460803 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9215ec9c-da88-4fa9-b3d0-2ae0810c0d16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:30.461044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9215ec9c-da88-4fa9-b3d0-2ae0810c0d16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:30.462052 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ede70755-358d-4903-a1b5-7e77e750c703 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:30.462970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ede70755-358d-4903-a1b5-7e77e750c703 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:30.470111 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede70755-358d-4903-a1b5-7e77e750c703 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:30.470967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede70755-358d-4903-a1b5-7e77e750c703 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:30.472260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede70755-358d-4903-a1b5-7e77e750c703 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:30.472637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ede70755-358d-4903-a1b5-7e77e750c703 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:30.551706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9215ec9c-da88-4fa9-b3d0-2ae0810c0d16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.103920 Jan 27 16:06:30.551706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 330/658] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:30 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:30.560455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ede70755-358d-4903-a1b5-7e77e750c703 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.102292 Jan 27 16:06:30.561108 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 329/659] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:30 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:30.924707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:30.925468 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:30.932397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:30.932862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:30.934178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:30.934617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:31.071986 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:31.080623 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1a7609d1-1ca6-4cd6-96ec-db09f00d4f9b tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.160002 Jan 27 16:06:31.081186 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 331/660] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:30 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:31.156359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:31.157168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:31.164254 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:31.164704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:31.165484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:31.165917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:31.316387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:31.324641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b45ebede-9c66-4c53-9d38-bb65457297b3 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1513 microversion: 2.1 time: 0.172066 Jan 27 16:06:31.325454 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 330/661] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:31 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:31.563847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f7b3998d-7659-428b-b17f-26a23c56da5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:31.564666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f7b3998d-7659-428b-b17f-26a23c56da5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:31.571415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7b3998d-7659-428b-b17f-26a23c56da5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:31.571855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0f9c9422-df59-4291-9e54-56dd9e6b3417 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:31.572304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7b3998d-7659-428b-b17f-26a23c56da5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:31.572716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7b3998d-7659-428b-b17f-26a23c56da5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:31.572945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0f9c9422-df59-4291-9e54-56dd9e6b3417 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:31.573167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7b3998d-7659-428b-b17f-26a23c56da5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:31.579699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0f9c9422-df59-4291-9e54-56dd9e6b3417 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:31.580262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0f9c9422-df59-4291-9e54-56dd9e6b3417 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:31.581062 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0f9c9422-df59-4291-9e54-56dd9e6b3417 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:31.581500 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0f9c9422-df59-4291-9e54-56dd9e6b3417 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:31.698340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f7b3998d-7659-428b-b17f-26a23c56da5f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.138077 Jan 27 16:06:31.699003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 332/662] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:31 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:31.712557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0f9c9422-df59-4291-9e54-56dd9e6b3417 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.144158 Jan 27 16:06:31.713191 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 331/663] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:31 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:32.098389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:32.100876 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:32.107869 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.108320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.109117 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.109554 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.287208 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:32.293281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-bbaf61f4-e653-407d-9a5e-62373bbab6a3 req-d6db17c8-907d-4f0a-b21e-1ac7c93d8a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402", "name": "network-vif-deleted", "tag": "24367130-5983-4920-adec-cf550eaa56f4"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:32.295321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:06:32.295321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:06:32.297079 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-44ab8a01-18d2-4404-83cf-53c521132fc7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.202662 Jan 27 16:06:32.298027 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 333/664] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:32 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:32.305747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-bbaf61f4-e653-407d-9a5e-62373bbab6a3 req-d6db17c8-907d-4f0a-b21e-1ac7c93d8a72 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.306213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-bbaf61f4-e653-407d-9a5e-62373bbab6a3 req-d6db17c8-907d-4f0a-b21e-1ac7c93d8a72 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.321440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-bbaf61f4-e653-407d-9a5e-62373bbab6a3 req-d6db17c8-907d-4f0a-b21e-1ac7c93d8a72 service nova] Creating event network-vif-deleted:24367130-5983-4920-adec-cf550eaa56f4 for instance a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 on hv-cinder-82635 Jan 27 16:06:32.327625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-bbaf61f4-e653-407d-9a5e-62373bbab6a3 req-d6db17c8-907d-4f0a-b21e-1ac7c93d8a72 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042745 Jan 27 16:06:32.328660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 332/665] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:06:32.345086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:32.345691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:32.352290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.353034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.353968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.354637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.430356 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:32.438561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e42fc5ad-a00a-4d61-ae0d-bbcce16b064a tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 200 len: 1302 microversion: 2.1 time: 0.099476 Jan 27 16:06:32.448054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 334/666] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:32 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:32.711243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4dc0aff1-7d13-4239-ac4e-6f79d7a80c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:32.712178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4dc0aff1-7d13-4239-ac4e-6f79d7a80c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:32.718546 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4dc0aff1-7d13-4239-ac4e-6f79d7a80c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.719005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4dc0aff1-7d13-4239-ac4e-6f79d7a80c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.719888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4dc0aff1-7d13-4239-ac4e-6f79d7a80c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.720340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4dc0aff1-7d13-4239-ac4e-6f79d7a80c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.727004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-952ed708-ca0e-4f42-b3aa-cdf28405cd8b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:32.728027 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-952ed708-ca0e-4f42-b3aa-cdf28405cd8b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:32.735539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-952ed708-ca0e-4f42-b3aa-cdf28405cd8b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.735983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-952ed708-ca0e-4f42-b3aa-cdf28405cd8b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.736772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-952ed708-ca0e-4f42-b3aa-cdf28405cd8b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:32.737202 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-952ed708-ca0e-4f42-b3aa-cdf28405cd8b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:32.808998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4dc0aff1-7d13-4239-ac4e-6f79d7a80c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.101672 Jan 27 16:06:32.809873 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 333/667] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:32 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:32.831856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-952ed708-ca0e-4f42-b3aa-cdf28405cd8b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.109725 Jan 27 16:06:32.834429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 335/668] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:32 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:33.314100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:33.314715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:33.321595 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.322110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.322831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.323307 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.455798 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:33.456488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:33.456601 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:33.463380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.463827 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.465156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.465582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.465804 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b64c0f6f-85d5-4a6e-9af4-d005853435e8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.155764 Jan 27 16:06:33.466389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 334/669] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:33 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:33.481728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] HTTP exception thrown: Instance a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 could not be found. Jan 27 16:06:33.482342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Returning 404 to user: Instance a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:06:33.483191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1822a501-6af8-4260-a71e-cb567e6e8ef0 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402" status: 404 len: 111 microversion: 2.1 time: 0.031355 Jan 27 16:06:33.483740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 336/670] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:33 2022] GET /compute/v2.1/servers/a84848f1-4b0b-43c4-b9ac-9ea1c8f8f402 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:06:33.821438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-19aafcd9-0409-4aef-9a62-7773b47ccb74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:33.822257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-19aafcd9-0409-4aef-9a62-7773b47ccb74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:33.829243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19aafcd9-0409-4aef-9a62-7773b47ccb74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.829724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19aafcd9-0409-4aef-9a62-7773b47ccb74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.830507 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19aafcd9-0409-4aef-9a62-7773b47ccb74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.830951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19aafcd9-0409-4aef-9a62-7773b47ccb74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.844940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-eeac24fe-0340-4539-a670-aabead709d51 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:33.845936 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-eeac24fe-0340-4539-a670-aabead709d51 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:33.852779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeac24fe-0340-4539-a670-aabead709d51 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.853304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeac24fe-0340-4539-a670-aabead709d51 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.854111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeac24fe-0340-4539-a670-aabead709d51 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:33.854550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeac24fe-0340-4539-a670-aabead709d51 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:33.903570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-19aafcd9-0409-4aef-9a62-7773b47ccb74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.086160 Jan 27 16:06:33.904374 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 335/671] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:33 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:33.936371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-eeac24fe-0340-4539-a670-aabead709d51 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.095435 Jan 27 16:06:33.937002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 337/672] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:33 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:34.484148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:34.484873 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:34.491823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.492275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.493054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.493489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.628234 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:34.628920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:34.635717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:34.635910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.636935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.637726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.638191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.645755 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c8b0f071-0b72-42d6-9ee7-1bf53def5b70 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.165594 Jan 27 16:06:34.646344 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 336/673] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:34 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:34.664641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:06:34.746180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-031aa46c-8d17-4e63-bbd1-edcf46f89720 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 204 len: 0 microversion: 2.1 time: 0.128994 Jan 27 16:06:34.746846 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 338/674] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:06:34 2022] DELETE /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:06:34.754839 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:34.755568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:34.762297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.762776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.763538 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.763973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.899955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:34.907860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-256be6ff-145c-43a2-b74b-4324a51faba8 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1513 microversion: 2.1 time: 0.156845 Jan 27 16:06:34.908421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 337/675] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:34 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:34.916192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8cf3fc1b-3f6f-4fbb-895b-9a0e0d5d3096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:34.917346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8cf3fc1b-3f6f-4fbb-895b-9a0e0d5d3096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:34.926747 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cf3fc1b-3f6f-4fbb-895b-9a0e0d5d3096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.927227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cf3fc1b-3f6f-4fbb-895b-9a0e0d5d3096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.928015 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cf3fc1b-3f6f-4fbb-895b-9a0e0d5d3096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.928451 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cf3fc1b-3f6f-4fbb-895b-9a0e0d5d3096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.948033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0b507e87-dc81-4471-ae96-1dd0250ba7dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:34.949091 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0b507e87-dc81-4471-ae96-1dd0250ba7dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:34.955546 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b507e87-dc81-4471-ae96-1dd0250ba7dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.956085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b507e87-dc81-4471-ae96-1dd0250ba7dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:34.956952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b507e87-dc81-4471-ae96-1dd0250ba7dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:34.957487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b507e87-dc81-4471-ae96-1dd0250ba7dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:35.022684 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8cf3fc1b-3f6f-4fbb-895b-9a0e0d5d3096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.110348 Jan 27 16:06:35.023373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 339/676] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:34 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:35.047758 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0b507e87-dc81-4471-ae96-1dd0250ba7dc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.103059 Jan 27 16:06:35.048445 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 338/677] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:34 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:35.663143 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:35.667463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:35.671194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:35.671650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:35.672677 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:35.673195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:35.812434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:35.822710 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7b179f40-462c-4a65-a246-bdaa01dcaf7c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.163543 Jan 27 16:06:35.823694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 340/678] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:35 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:35.925303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:35.925903 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:35.933545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:35.933998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:35.934781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:35.935248 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:36.035640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-430269a9-fca3-406f-be86-1adeb765e0e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:36.036717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-430269a9-fca3-406f-be86-1adeb765e0e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:36.044604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-430269a9-fca3-406f-be86-1adeb765e0e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:36.045077 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-430269a9-fca3-406f-be86-1adeb765e0e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:36.045878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-430269a9-fca3-406f-be86-1adeb765e0e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:36.046320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-430269a9-fca3-406f-be86-1adeb765e0e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:36.076859 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:36.085740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d830ad3a-2a72-499d-a768-d18fa577f6f4 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1513 microversion: 2.1 time: 0.164507 Jan 27 16:06:36.086335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 339/679] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:35 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:36.090711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cd50568b-a21d-4517-9655-92a71830d877 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:36.091643 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cd50568b-a21d-4517-9655-92a71830d877 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:36.097777 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd50568b-a21d-4517-9655-92a71830d877 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:36.098228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd50568b-a21d-4517-9655-92a71830d877 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:36.099064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd50568b-a21d-4517-9655-92a71830d877 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:36.099539 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cd50568b-a21d-4517-9655-92a71830d877 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:36.139557 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-430269a9-fca3-406f-be86-1adeb765e0e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.107438 Jan 27 16:06:36.140474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 341/680] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:36 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:36.177046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cd50568b-a21d-4517-9655-92a71830d877 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.089474 Jan 27 16:06:36.177778 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 340/681] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:36 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:36.841268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:36.841953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:36.849074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:36.849517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:36.850303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:36.850713 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:36.987305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:36.998542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-061ec7f8-6934-4d44-900d-d3011cda9c9e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.161714 Jan 27 16:06:36.999340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 342/682] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:36 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:37.107704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:37.108542 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:37.116788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:37.117344 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:37.118271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:37.119079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:37.150930 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-39c546c8-1336-4bed-891b-3bac3bebcbab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:37.151860 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-39c546c8-1336-4bed-891b-3bac3bebcbab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:37.158010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39c546c8-1336-4bed-891b-3bac3bebcbab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:37.158464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39c546c8-1336-4bed-891b-3bac3bebcbab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:37.159261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39c546c8-1336-4bed-891b-3bac3bebcbab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:37.159697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39c546c8-1336-4bed-891b-3bac3bebcbab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:37.276634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:37.284966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-39c546c8-1336-4bed-891b-3bac3bebcbab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.137292 Jan 27 16:06:37.285370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-97b37b3f-de62-4d60-bfd2-2ececd9c2593 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1513 microversion: 2.1 time: 0.183392 Jan 27 16:06:37.286496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 343/683] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:37 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:37.286644 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 341/684] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:37 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:37.292672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-eeb5772a-b7bb-4c6a-9db8-d79ea9a2ba7b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:37.293879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-eeb5772a-b7bb-4c6a-9db8-d79ea9a2ba7b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:37.302321 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeb5772a-b7bb-4c6a-9db8-d79ea9a2ba7b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:37.302907 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeb5772a-b7bb-4c6a-9db8-d79ea9a2ba7b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:37.303912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeb5772a-b7bb-4c6a-9db8-d79ea9a2ba7b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:37.304470 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eeb5772a-b7bb-4c6a-9db8-d79ea9a2ba7b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:37.421032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-eeb5772a-b7bb-4c6a-9db8-d79ea9a2ba7b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.133402 Jan 27 16:06:37.421679 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 344/685] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:37 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:38.019922 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:38.020450 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:38.027424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.027853 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.028659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.029092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.244065 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:38.253458 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c5fc5ea9-8674-4dd4-a84f-a6bc5f3970f2 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1566 microversion: 2.1 time: 0.237234 Jan 27 16:06:38.254036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 342/686] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:38 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:38.299209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-901b23e7-66ae-4383-88cf-0e0c2b16edad tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:38.301126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-901b23e7-66ae-4383-88cf-0e0c2b16edad tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:38.302660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:38.303359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:38.311251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-901b23e7-66ae-4383-88cf-0e0c2b16edad tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.311976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-901b23e7-66ae-4383-88cf-0e0c2b16edad tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.313285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-901b23e7-66ae-4383-88cf-0e0c2b16edad tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.315788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.316252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.317127 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.317434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-901b23e7-66ae-4383-88cf-0e0c2b16edad tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.317557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.491281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-901b23e7-66ae-4383-88cf-0e0c2b16edad tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.196505 Jan 27 16:06:38.492256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 345/687] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:38 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:38.500364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3f75516c-9e94-484c-99f4-50c308e1caf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:38.501974 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3f75516c-9e94-484c-99f4-50c308e1caf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:38.511748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f75516c-9e94-484c-99f4-50c308e1caf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.512499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f75516c-9e94-484c-99f4-50c308e1caf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.513617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f75516c-9e94-484c-99f4-50c308e1caf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.514426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3f75516c-9e94-484c-99f4-50c308e1caf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.601983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3f75516c-9e94-484c-99f4-50c308e1caf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.107326 Jan 27 16:06:38.607329 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 346/688] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:38 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:38.621940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:38.629615 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b21f3c87-6597-4a95-bd73-8196a03c9e0d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 200 len: 1471 microversion: 2.1 time: 0.330452 Jan 27 16:06:38.630532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 343/689] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:38 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:38.672057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-17b821fe-b3f2-4eea-8be6-bde6fb478a79 req-f86f3f68-0548-4b4e-82e5-ca9f5e2bca31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58c7f78-f603-48c5-abf5-7aa03f151ee1", "name": "network-vif-deleted", "tag": "61551a6c-acfc-484d-95a8-88d5fd843807"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:38.673962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:06:38.673962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:06:38.683691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-17b821fe-b3f2-4eea-8be6-bde6fb478a79 req-f86f3f68-0548-4b4e-82e5-ca9f5e2bca31 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:38.684150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-17b821fe-b3f2-4eea-8be6-bde6fb478a79 req-f86f3f68-0548-4b4e-82e5-ca9f5e2bca31 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:38.696925 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-17b821fe-b3f2-4eea-8be6-bde6fb478a79 req-f86f3f68-0548-4b4e-82e5-ca9f5e2bca31 service nova] Creating event network-vif-deleted:61551a6c-acfc-484d-95a8-88d5fd843807 for instance f58c7f78-f603-48c5-abf5-7aa03f151ee1 on hv-cinder-82635 Jan 27 16:06:38.702634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-17b821fe-b3f2-4eea-8be6-bde6fb478a79 req-f86f3f68-0548-4b4e-82e5-ca9f5e2bca31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035470 Jan 27 16:06:38.703706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 347/690] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:06:39.269851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:39.270487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.277528 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.277984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.278778 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.279246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.427933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:39.437072 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6b799838-fa28-436e-87d0-95c5749525ed tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1546 microversion: 2.1 time: 0.170834 Jan 27 16:06:39.438325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 344/691] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:39 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:39.455507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:39.456197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.462149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.462601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.463414 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.463901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.504504 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8375e68f-a4d9-481e-b8ea-beac37b9b85b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:39.505446 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8375e68f-a4d9-481e-b8ea-beac37b9b85b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.512103 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8375e68f-a4d9-481e-b8ea-beac37b9b85b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.512894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8375e68f-a4d9-481e-b8ea-beac37b9b85b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.513710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8375e68f-a4d9-481e-b8ea-beac37b9b85b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.514155 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8375e68f-a4d9-481e-b8ea-beac37b9b85b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.545080 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] HTTP exception thrown: Cannot 'detach_volume' instance e56702b3-830c-441b-b790-b13f42d20c0d while it is in vm_state rescued Jan 27 16:06:39.545769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Returning 409 to user: Cannot 'detach_volume' instance e56702b3-830c-441b-b790-b13f42d20c0d while it is in vm_state rescued {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:06:39.546555 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-58e96d90-965e-452b-a0a3-963828974d42 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments/681d4538-9943-450a-89bb-a4846613a3fb" status: 409 len: 152 microversion: 2.1 time: 0.095773 Jan 27 16:06:39.547119 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 348/692] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:06:39 2022] DELETE /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments/681d4538-9943-450a-89bb-a4846613a3fb => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 27 16:06:39.554868 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2b7d8111-693c-4350-a867-2b0adf0b7a66 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:39.555420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2b7d8111-693c-4350-a867-2b0adf0b7a66 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.562268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b7d8111-693c-4350-a867-2b0adf0b7a66 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.562734 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b7d8111-693c-4350-a867-2b0adf0b7a66 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.563564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b7d8111-693c-4350-a867-2b0adf0b7a66 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.563999 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2b7d8111-693c-4350-a867-2b0adf0b7a66 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.596682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8375e68f-a4d9-481e-b8ea-beac37b9b85b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.096274 Jan 27 16:06:39.600653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 345/693] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:39 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:39.614367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a59bc562-468b-469e-8448-fba6e808722e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:39.615403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a59bc562-468b-469e-8448-fba6e808722e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.623290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a59bc562-468b-469e-8448-fba6e808722e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.623737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a59bc562-468b-469e-8448-fba6e808722e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.624524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a59bc562-468b-469e-8448-fba6e808722e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.624955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a59bc562-468b-469e-8448-fba6e808722e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.631619 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2b7d8111-693c-4350-a867-2b0adf0b7a66 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.079857 Jan 27 16:06:39.635388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 349/694] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:39 2022] POST /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:39.647227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:39.647928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.654714 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.655204 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.656036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.656490 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.703863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a59bc562-468b-469e-8448-fba6e808722e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.093491 Jan 27 16:06:39.704815 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 346/695] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:39 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:39.713078 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:39.714005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: f58c7f78-f603-48c5-abf5-7aa03f151ee1] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.722235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.722697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.723503 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.724050 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.744654 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] HTTP exception thrown: Instance f58c7f78-f603-48c5-abf5-7aa03f151ee1 could not be found. Jan 27 16:06:39.746251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Returning 404 to user: Instance f58c7f78-f603-48c5-abf5-7aa03f151ee1 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:06:39.747119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-82ba9e5a-c1fb-4b6b-b491-d1dd52439347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1" status: 404 len: 111 microversion: 2.1 time: 0.041059 Jan 27 16:06:39.747678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 347/696] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:39 2022] GET /compute/v2.1/servers/f58c7f78-f603-48c5-abf5-7aa03f151ee1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:06:39.755841 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:39.756348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.762963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.763456 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.764259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.764700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.790963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:06:39.812476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:39.826543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4bdd65dd-71b1-4ff4-a80d-0a3b3fff9674 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1554 microversion: 2.1 time: 0.186996 Jan 27 16:06:39.827198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 350/697] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:39 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:39.888764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e42ae49a-23a1-426c-9ad9-f8220719df3b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 204 len: 0 microversion: 2.1 time: 0.136307 Jan 27 16:06:39.889494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 348/698] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:06:39 2022] DELETE /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:06:39.897197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:39.897811 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:39.904716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.905168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:39.905963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:39.906402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:40.049608 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:40.057561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6b855327-4e12-4a58-a4cf-9891c6b34e87 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.163922 Jan 27 16:06:40.058126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 351/699] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:39 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:40.609561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f1871fc7-4af2-475a-8ae5-023ad070a877 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:40.610559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f1871fc7-4af2-475a-8ae5-023ad070a877 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:40.617080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1871fc7-4af2-475a-8ae5-023ad070a877 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:40.617530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1871fc7-4af2-475a-8ae5-023ad070a877 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:40.618630 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1871fc7-4af2-475a-8ae5-023ad070a877 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:40.619107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1871fc7-4af2-475a-8ae5-023ad070a877 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:40.691919 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f1871fc7-4af2-475a-8ae5-023ad070a877 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.086902 Jan 27 16:06:40.692561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 349/700] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:40 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:40.718000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-90d96ccc-1951-42ff-a5c9-5997a83bf897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:40.719003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-90d96ccc-1951-42ff-a5c9-5997a83bf897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:40.725535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90d96ccc-1951-42ff-a5c9-5997a83bf897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:40.725986 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90d96ccc-1951-42ff-a5c9-5997a83bf897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:40.726781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90d96ccc-1951-42ff-a5c9-5997a83bf897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:40.727241 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90d96ccc-1951-42ff-a5c9-5997a83bf897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:40.843967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:40.844659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:40.851509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:40.851964 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:40.852776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:40.853212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:40.905870 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-90d96ccc-1951-42ff-a5c9-5997a83bf897 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.191772 Jan 27 16:06:40.907348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 352/701] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:40 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:40.989622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:40.998054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5ee57a12-cf44-4d94-997d-7a44893622de tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1554 microversion: 2.1 time: 0.158180 Jan 27 16:06:40.998608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 350/702] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:40 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:41.075415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:41.076105 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:41.082881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:41.083364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:41.084136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:41.084604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:41.212786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:41.221123 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-961e3bc3-fe12-4a44-a403-48552ee9acd6 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.149857 Jan 27 16:06:41.221672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 353/703] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:41 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:41.703527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3ab99b7b-09de-4564-bf66-8af97f1e264e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:41.704353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3ab99b7b-09de-4564-bf66-8af97f1e264e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:41.710553 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3ab99b7b-09de-4564-bf66-8af97f1e264e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:41.711026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3ab99b7b-09de-4564-bf66-8af97f1e264e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:41.711791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3ab99b7b-09de-4564-bf66-8af97f1e264e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:41.712220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3ab99b7b-09de-4564-bf66-8af97f1e264e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:41.861632 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3ab99b7b-09de-4564-bf66-8af97f1e264e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.161671 Jan 27 16:06:41.862298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 351/704] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:41 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:41.917934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5e4fde89-b452-4554-871e-09c1f1913c55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:41.919008 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5e4fde89-b452-4554-871e-09c1f1913c55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:41.925636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5e4fde89-b452-4554-871e-09c1f1913c55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:41.926090 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5e4fde89-b452-4554-871e-09c1f1913c55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:41.927092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5e4fde89-b452-4554-871e-09c1f1913c55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:41.928431 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5e4fde89-b452-4554-871e-09c1f1913c55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:42.015055 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:42.015746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:42.024101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:42.024551 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:42.025342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:42.025772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:42.157217 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:42.165206 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ae884d7d-d433-49b9-a121-251d1432a0d7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1554 microversion: 2.1 time: 0.154785 Jan 27 16:06:42.165760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 352/705] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:42 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:42.237160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:42.237685 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:42.243744 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:42.244193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:42.245467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:42.245901 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:42.281505 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5e4fde89-b452-4554-871e-09c1f1913c55 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.367233 Jan 27 16:06:42.282286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 354/706] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:41 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:42.405106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:42.412336 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-abf6d62c-b53e-445a-9fa9-965a38a7022b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.178704 Jan 27 16:06:42.421145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 353/707] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:42 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:42.841930 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-57e16737-1e99-4952-9e38-b6c14b83687d req-42d70e3a-5c27-4f79-b285-496e4bb71eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8473746f-8e75-4ea0-a903-ccb17613eb4c", "name": "network-vif-deleted", "tag": "7cedd957-2069-4ea7-b587-46284400992b"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:42.843773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:06:42.843773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:06:42.851784 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-57e16737-1e99-4952-9e38-b6c14b83687d req-42d70e3a-5c27-4f79-b285-496e4bb71eff service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:42.852357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-57e16737-1e99-4952-9e38-b6c14b83687d req-42d70e3a-5c27-4f79-b285-496e4bb71eff service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:42.864575 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-57e16737-1e99-4952-9e38-b6c14b83687d req-42d70e3a-5c27-4f79-b285-496e4bb71eff service nova] Creating event network-vif-deleted:7cedd957-2069-4ea7-b587-46284400992b for instance 8473746f-8e75-4ea0-a903-ccb17613eb4c on hv-cinder-82635 Jan 27 16:06:42.870944 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-57e16737-1e99-4952-9e38-b6c14b83687d req-42d70e3a-5c27-4f79-b285-496e4bb71eff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033941 Jan 27 16:06:42.872088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 355/708] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:06:42.875138 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fc63f88c-164e-4b8a-8f9b-02bcf6679e93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:42.876314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fc63f88c-164e-4b8a-8f9b-02bcf6679e93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:42.889208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc63f88c-164e-4b8a-8f9b-02bcf6679e93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:42.889663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc63f88c-164e-4b8a-8f9b-02bcf6679e93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:42.890715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc63f88c-164e-4b8a-8f9b-02bcf6679e93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:42.891266 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc63f88c-164e-4b8a-8f9b-02bcf6679e93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:43.038308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fc63f88c-164e-4b8a-8f9b-02bcf6679e93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.168029 Jan 27 16:06:43.038953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 354/709] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:42 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:43.183545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:43.184231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:43.190398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:43.190850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:43.191663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:43.192097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:43.295011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4936ccd7-8856-4f87-b8f0-7e9af37adbd6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:43.296015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4936ccd7-8856-4f87-b8f0-7e9af37adbd6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:43.303945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4936ccd7-8856-4f87-b8f0-7e9af37adbd6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:43.304393 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4936ccd7-8856-4f87-b8f0-7e9af37adbd6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:43.305173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4936ccd7-8856-4f87-b8f0-7e9af37adbd6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:43.305775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4936ccd7-8856-4f87-b8f0-7e9af37adbd6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:43.329808 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:43.339050 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e11f9982-60a3-4e27-a2fc-f38c4fc7c7e7 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1554 microversion: 2.1 time: 0.160381 Jan 27 16:06:43.339615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 356/710] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:43 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:43.429467 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:43.430072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 8473746f-8e75-4ea0-a903-ccb17613eb4c] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:43.437489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:43.437938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:43.438740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:43.439210 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:43.447685 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4936ccd7-8856-4f87-b8f0-7e9af37adbd6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.157510 Jan 27 16:06:43.448364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 355/711] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:43 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:43.456084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] HTTP exception thrown: Instance 8473746f-8e75-4ea0-a903-ccb17613eb4c could not be found. Jan 27 16:06:43.456741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Returning 404 to user: Instance 8473746f-8e75-4ea0-a903-ccb17613eb4c could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:06:43.457699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-155f0acc-8be2-41fb-8030-441860414089 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c" status: 404 len: 111 microversion: 2.1 time: 0.031987 Jan 27 16:06:43.458400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 357/712] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:43 2022] GET /compute/v2.1/servers/8473746f-8e75-4ea0-a903-ccb17613eb4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:06:44.050330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ae65fede-75e0-492d-b2b3-2a4b9c689488 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:44.051268 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ae65fede-75e0-492d-b2b3-2a4b9c689488 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:44.058052 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae65fede-75e0-492d-b2b3-2a4b9c689488 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.058500 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae65fede-75e0-492d-b2b3-2a4b9c689488 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.059329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae65fede-75e0-492d-b2b3-2a4b9c689488 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.059762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ae65fede-75e0-492d-b2b3-2a4b9c689488 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.122742 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ae65fede-75e0-492d-b2b3-2a4b9c689488 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.076369 Jan 27 16:06:44.123416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 356/713] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:44 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:44.356533 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:44.357178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:44.363790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.364237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.365017 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.365448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.459857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-26dd8280-d831-41ca-932f-9afefba232fe tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:44.460929 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-26dd8280-d831-41ca-932f-9afefba232fe tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:44.469393 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-26dd8280-d831-41ca-932f-9afefba232fe tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.469934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-26dd8280-d831-41ca-932f-9afefba232fe tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.470804 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-26dd8280-d831-41ca-932f-9afefba232fe tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.471339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-26dd8280-d831-41ca-932f-9afefba232fe tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.509713 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:44.520424 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5671076a-af03-426d-b660-3818eaebfaeb tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1560 microversion: 2.1 time: 0.168030 Jan 27 16:06:44.521884 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 358/714] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:44 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:44.557880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-26dd8280-d831-41ca-932f-9afefba232fe tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.101849 Jan 27 16:06:44.558532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 357/715] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:44 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:44.586751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:44.587380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:44.593753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.594201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.595003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.595446 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.599786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:44.600400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:44.608606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.609081 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.610086 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.610520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.636618 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:06:44.679135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lazy-loading 'services' on Instance uuid e56702b3-830c-441b-b790-b13f42d20c0d {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:06:44.718136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-77d0d151-2017-4194-acc4-609446c95347 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 204 len: 0 microversion: 2.1 time: 0.121950 Jan 27 16:06:44.718865 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 358/716] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:06:44 2022] DELETE /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:06:44.727104 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:44.727707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:44.733914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.734381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.735259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.735694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.755757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4939c979-10ad-42b0-b5ba-ed582083a848 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments/681d4538-9943-450a-89bb-a4846613a3fb" status: 202 len: 0 microversion: 2.1 time: 0.172468 Jan 27 16:06:44.757094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 359/717] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:06:44 2022] DELETE /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments/681d4538-9943-450a-89bb-a4846613a3fb => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:44.768076 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4658148d-8698-4fc0-a357-7319a6e1f99f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:44.769378 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4658148d-8698-4fc0-a357-7319a6e1f99f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:44.776026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4658148d-8698-4fc0-a357-7319a6e1f99f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.778330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4658148d-8698-4fc0-a357-7319a6e1f99f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.779450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4658148d-8698-4fc0-a357-7319a6e1f99f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:44.780087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4658148d-8698-4fc0-a357-7319a6e1f99f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:44.811734 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4658148d-8698-4fc0-a357-7319a6e1f99f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048569 Jan 27 16:06:44.814906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 360/718] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:06:44 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:06:44.903383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:44.910630 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2bb494dd-3439-49dc-9385-d48f09a4625d tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1514 microversion: 2.1 time: 0.187480 Jan 27 16:06:44.911355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 359/719] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:44 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:45.134451 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-170bfb89-6ff7-4fed-b5ff-adcc9dcb5979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:45.135432 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-170bfb89-6ff7-4fed-b5ff-adcc9dcb5979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:45.142238 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-170bfb89-6ff7-4fed-b5ff-adcc9dcb5979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.142687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-170bfb89-6ff7-4fed-b5ff-adcc9dcb5979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:45.143497 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-170bfb89-6ff7-4fed-b5ff-adcc9dcb5979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.143935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-170bfb89-6ff7-4fed-b5ff-adcc9dcb5979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:45.230898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-170bfb89-6ff7-4fed-b5ff-adcc9dcb5979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.099891 Jan 27 16:06:45.231584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 361/720] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:45 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:45.569090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0c80da45-1c90-41ec-b384-30fd943f8954 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:45.570001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0c80da45-1c90-41ec-b384-30fd943f8954 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:45.576386 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c80da45-1c90-41ec-b384-30fd943f8954 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.576829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c80da45-1c90-41ec-b384-30fd943f8954 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:45.577607 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c80da45-1c90-41ec-b384-30fd943f8954 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.578067 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c80da45-1c90-41ec-b384-30fd943f8954 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:45.656026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0c80da45-1c90-41ec-b384-30fd943f8954 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.090374 Jan 27 16:06:45.656679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 360/721] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:45 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:45.827843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1d547e5d-b78a-433e-a64c-674b05c351dd tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:45.828868 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1d547e5d-b78a-433e-a64c-674b05c351dd tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:45.835664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d547e5d-b78a-433e-a64c-674b05c351dd tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.836122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d547e5d-b78a-433e-a64c-674b05c351dd tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:45.836912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d547e5d-b78a-433e-a64c-674b05c351dd tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.837352 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d547e5d-b78a-433e-a64c-674b05c351dd tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:45.867033 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1d547e5d-b78a-433e-a64c-674b05c351dd tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043282 Jan 27 16:06:45.867610 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 362/722] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:06:45 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:06:45.928572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:45.930775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:45.936597 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.937050 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:45.937872 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:45.938300 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:46.077739 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:46.085152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-65df3536-e366-4e06-9705-2a13b30ed414 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1514 microversion: 2.1 time: 0.160984 Jan 27 16:06:46.085717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 361/723] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:45 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:46.241700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-012934ee-9409-46cf-bf36-7d1f3518d148 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:46.242614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-012934ee-9409-46cf-bf36-7d1f3518d148 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:46.249163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-012934ee-9409-46cf-bf36-7d1f3518d148 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:46.249614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-012934ee-9409-46cf-bf36-7d1f3518d148 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:46.250410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-012934ee-9409-46cf-bf36-7d1f3518d148 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:46.250850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-012934ee-9409-46cf-bf36-7d1f3518d148 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:46.328011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-012934ee-9409-46cf-bf36-7d1f3518d148 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.089782 Jan 27 16:06:46.328556 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 363/724] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:46 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:46.667919 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a7f8bce2-7543-4c1c-a2a5-93450981502a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:46.668832 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a7f8bce2-7543-4c1c-a2a5-93450981502a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:46.675188 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7f8bce2-7543-4c1c-a2a5-93450981502a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:46.675647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7f8bce2-7543-4c1c-a2a5-93450981502a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:46.676438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7f8bce2-7543-4c1c-a2a5-93450981502a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:46.676879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a7f8bce2-7543-4c1c-a2a5-93450981502a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:46.757429 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a7f8bce2-7543-4c1c-a2a5-93450981502a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.093009 Jan 27 16:06:46.758062 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 362/725] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:46 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:47.103294 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:47.104429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:47.111793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:47.112247 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:47.113052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:47.113493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:47.246275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:47.254121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e6b24b5e-5cec-404d-b818-22d0c2133c0b tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1514 microversion: 2.1 time: 0.155358 Jan 27 16:06:47.254668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 364/726] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:47 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:47.339909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6486c956-3643-44c3-bbe0-2c2c6aa73e74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:47.341034 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6486c956-3643-44c3-bbe0-2c2c6aa73e74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:47.347852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6486c956-3643-44c3-bbe0-2c2c6aa73e74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:47.348281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6486c956-3643-44c3-bbe0-2c2c6aa73e74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:47.349069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6486c956-3643-44c3-bbe0-2c2c6aa73e74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:47.349576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6486c956-3643-44c3-bbe0-2c2c6aa73e74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:47.542554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6486c956-3643-44c3-bbe0-2c2c6aa73e74 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.206311 Jan 27 16:06:47.543234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 363/727] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:47 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:47.773561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5432e79d-4a89-412d-be35-f3ac123d86cc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:47.774562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5432e79d-4a89-412d-be35-f3ac123d86cc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:47.782024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5432e79d-4a89-412d-be35-f3ac123d86cc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:47.782751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5432e79d-4a89-412d-be35-f3ac123d86cc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:47.783760 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5432e79d-4a89-412d-be35-f3ac123d86cc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:47.784202 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5432e79d-4a89-412d-be35-f3ac123d86cc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:47.851281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5432e79d-4a89-412d-be35-f3ac123d86cc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.085073 Jan 27 16:06:47.855378 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 365/728] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:47 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:48.179446 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:48.180130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:48.187532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.187996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.188850 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.189290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.198949 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-9c253a47-6f8a-4edb-83e9-0680001b816c req-e5871804-7980-4252-8bd1-79e3d02c574f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdcde5c-e6f9-45cc-9173-2a47cd7459ee", "name": "network-vif-deleted", "tag": "9d581be4-aa99-4784-808d-72ecbb0595a4"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:48.200488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:06:48.200488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:06:48.208782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-9c253a47-6f8a-4edb-83e9-0680001b816c req-e5871804-7980-4252-8bd1-79e3d02c574f service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.209223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-9c253a47-6f8a-4edb-83e9-0680001b816c req-e5871804-7980-4252-8bd1-79e3d02c574f service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.218142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:06:48.221300 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-9c253a47-6f8a-4edb-83e9-0680001b816c req-e5871804-7980-4252-8bd1-79e3d02c574f service nova] Creating event network-vif-deleted:9d581be4-aa99-4784-808d-72ecbb0595a4 for instance 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee on hv-cinder-82635 Jan 27 16:06:48.226293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-9c253a47-6f8a-4edb-83e9-0680001b816c req-e5871804-7980-4252-8bd1-79e3d02c574f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031110 Jan 27 16:06:48.226947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 366/729] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:06:48.271209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:48.272034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:48.281465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.281845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.282727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.283604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.309268 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e7010446-dfc6-4e27-a9bd-14fcf1ef42a1 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "DELETE /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 204 len: 0 microversion: 2.1 time: 0.133857 Jan 27 16:06:48.309935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 364/730] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:06:48 2022] DELETE /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:06:48.318069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:48.318877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:48.320478 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.320955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.321408 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lazy-loading 'fault' on Instance uuid 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:06:48.325680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.326219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.327123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.327638 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.369448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8173ea1633470785f53cd6fc0e9e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff07a1c1705459093c50413a35df253', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:48.377662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-058a937d-a29c-4575-a4b0-1f393ada23dc tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 200 len: 1308 microversion: 2.1 time: 0.110707 Jan 27 16:06:48.378237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 367/731] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:48 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:48.466665 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:48.474169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b5423d8b-773f-45a5-a541-9adc7949fef9 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1508 microversion: 2.1 time: 0.160021 Jan 27 16:06:48.474772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 365/732] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:48 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:06:48.555312 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9f8a0799-1574-4f5d-9f76-f31eb020a224 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:48.556226 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9f8a0799-1574-4f5d-9f76-f31eb020a224 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:48.563953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9f8a0799-1574-4f5d-9f76-f31eb020a224 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.564405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9f8a0799-1574-4f5d-9f76-f31eb020a224 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.565215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9f8a0799-1574-4f5d-9f76-f31eb020a224 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.565646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9f8a0799-1574-4f5d-9f76-f31eb020a224 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.653824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9f8a0799-1574-4f5d-9f76-f31eb020a224 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.101919 Jan 27 16:06:48.654418 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 368/733] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:48 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:48.863391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1d70eaef-f077-4524-b4b8-a9ac3b1f304e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:48.864324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1d70eaef-f077-4524-b4b8-a9ac3b1f304e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:48.871744 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d70eaef-f077-4524-b4b8-a9ac3b1f304e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.872194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d70eaef-f077-4524-b4b8-a9ac3b1f304e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.872978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d70eaef-f077-4524-b4b8-a9ac3b1f304e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:48.873480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d70eaef-f077-4524-b4b8-a9ac3b1f304e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:48.940242 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1d70eaef-f077-4524-b4b8-a9ac3b1f304e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.080555 Jan 27 16:06:48.940786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 366/734] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:48 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:49.394632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:49.395357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] [instance: 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:49.402339 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.402787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:49.403602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.404037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:49.418707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] HTTP exception thrown: Instance 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee could not be found. Jan 27 16:06:49.419318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] Returning 404 to user: Instance 3fdcde5c-e6f9-45cc-9173-2a47cd7459ee could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:06:49.420148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7ac994fd-b351-4cb1-b5dc-31fab1a53bd9 tempest-AttachVolumeNegativeTest-165587263 tempest-AttachVolumeNegativeTest-165587263-project] 10.222.0.61 "GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee" status: 404 len: 111 microversion: 2.1 time: 0.029641 Jan 27 16:06:49.420691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 369/735] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:49 2022] GET /compute/v2.1/servers/3fdcde5c-e6f9-45cc-9173-2a47cd7459ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:06:49.492446 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:49.493409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:49.500765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.501223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:49.502014 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.502453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:49.643822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:49.660573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4a1927c3-9ce8-4740-a231-81721dcc5480 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1508 microversion: 2.1 time: 0.172198 Jan 27 16:06:49.661424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 367/736] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:49 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:49.665164 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4cec397b-67dd-4dfa-be4e-710982ed19ba tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:49.666257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4cec397b-67dd-4dfa-be4e-710982ed19ba tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:49.675562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cec397b-67dd-4dfa-be4e-710982ed19ba tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.676035 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cec397b-67dd-4dfa-be4e-710982ed19ba tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:49.676902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cec397b-67dd-4dfa-be4e-710982ed19ba tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.677629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4cec397b-67dd-4dfa-be4e-710982ed19ba tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:49.752329 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4cec397b-67dd-4dfa-be4e-710982ed19ba tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.090573 Jan 27 16:06:49.752977 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 370/737] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:49 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:49.952390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-abee2e4b-b284-4626-afc0-49cc5db602b1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:49.953318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-abee2e4b-b284-4626-afc0-49cc5db602b1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:49.959976 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abee2e4b-b284-4626-afc0-49cc5db602b1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.960428 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abee2e4b-b284-4626-afc0-49cc5db602b1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:49.961235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abee2e4b-b284-4626-afc0-49cc5db602b1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:49.961675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abee2e4b-b284-4626-afc0-49cc5db602b1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:50.027605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-abee2e4b-b284-4626-afc0-49cc5db602b1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.078738 Jan 27 16:06:50.032459 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 368/738] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:49 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:50.679199 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:50.679941 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:50.688149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:50.688678 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:50.689395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:50.689828 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:50.765113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-89d863cd-ff19-4e5e-8d9d-e659a18b00bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:50.766559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-89d863cd-ff19-4e5e-8d9d-e659a18b00bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:50.774838 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89d863cd-ff19-4e5e-8d9d-e659a18b00bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:50.776219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89d863cd-ff19-4e5e-8d9d-e659a18b00bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:50.777678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89d863cd-ff19-4e5e-8d9d-e659a18b00bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:50.778130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-89d863cd-ff19-4e5e-8d9d-e659a18b00bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:50.847889 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:50.855440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6d61af0a-ddef-4c56-867f-1cd60b321aa4 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1508 microversion: 2.1 time: 0.180589 Jan 27 16:06:50.856083 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 371/739] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:50 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:50.895368 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-89d863cd-ff19-4e5e-8d9d-e659a18b00bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.134724 Jan 27 16:06:50.896506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 369/740] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:50 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:51.040302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2a02563a-5014-4cc0-a854-dbab62f59a48 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:51.041284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2a02563a-5014-4cc0-a854-dbab62f59a48 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:51.047951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a02563a-5014-4cc0-a854-dbab62f59a48 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:51.048411 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a02563a-5014-4cc0-a854-dbab62f59a48 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:51.049204 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a02563a-5014-4cc0-a854-dbab62f59a48 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:51.049649 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a02563a-5014-4cc0-a854-dbab62f59a48 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:51.137816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2a02563a-5014-4cc0-a854-dbab62f59a48 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.101241 Jan 27 16:06:51.141724 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 372/741] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:51 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:51.874154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:51.874646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:51.881456 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:51.881924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:51.882760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:51.884816 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:51.908125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-257f2dee-e5ff-4617-b995-28fe142bb422 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:51.909332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-257f2dee-e5ff-4617-b995-28fe142bb422 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:51.923547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-257f2dee-e5ff-4617-b995-28fe142bb422 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:51.924036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-257f2dee-e5ff-4617-b995-28fe142bb422 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:51.925145 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-257f2dee-e5ff-4617-b995-28fe142bb422 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:51.925597 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-257f2dee-e5ff-4617-b995-28fe142bb422 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:52.018573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-257f2dee-e5ff-4617-b995-28fe142bb422 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.114343 Jan 27 16:06:52.019537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 373/742] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:51 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:52.123808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:52.132156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bc26ebb7-8a43-4c40-bb32-26b8b5ce3a52 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1508 microversion: 2.1 time: 0.263052 Jan 27 16:06:52.132743 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 370/743] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:51 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:52.152579 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b0e29f49-886b-4187-8a58-4bd792c69a5a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:52.154037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b0e29f49-886b-4187-8a58-4bd792c69a5a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:52.163834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e29f49-886b-4187-8a58-4bd792c69a5a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:52.164298 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e29f49-886b-4187-8a58-4bd792c69a5a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:52.165967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e29f49-886b-4187-8a58-4bd792c69a5a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:52.166678 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e29f49-886b-4187-8a58-4bd792c69a5a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:52.249775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b0e29f49-886b-4187-8a58-4bd792c69a5a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.103541 Jan 27 16:06:52.253702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 374/744] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:52 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:52.424005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-4d436185-c77a-4fbb-9b4d-b76614e9b524 req-1fa6d74c-a7a5-4d82-aa57-1c2a3cd07b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c1dfef-ceda-489a-a7ea-045b8ab0f249", "name": "network-vif-deleted", "tag": "02126963-aa69-4146-be3b-fb8b3197466e"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:52.426355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:06:52.426355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:06:52.434870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-4d436185-c77a-4fbb-9b4d-b76614e9b524 req-1fa6d74c-a7a5-4d82-aa57-1c2a3cd07b1c service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:52.435636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-4d436185-c77a-4fbb-9b4d-b76614e9b524 req-1fa6d74c-a7a5-4d82-aa57-1c2a3cd07b1c service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:52.448616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-4d436185-c77a-4fbb-9b4d-b76614e9b524 req-1fa6d74c-a7a5-4d82-aa57-1c2a3cd07b1c service nova] Creating event network-vif-deleted:02126963-aa69-4146-be3b-fb8b3197466e for instance 53c1dfef-ceda-489a-a7ea-045b8ab0f249 on hv-cinder-82635 Jan 27 16:06:52.454123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-4d436185-c77a-4fbb-9b4d-b76614e9b524 req-1fa6d74c-a7a5-4d82-aa57-1c2a3cd07b1c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034164 Jan 27 16:06:52.455177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 371/745] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:06:53.031996 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cbfcffdb-b02f-4340-b14d-350854135ba7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:53.033300 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cbfcffdb-b02f-4340-b14d-350854135ba7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:53.041496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbfcffdb-b02f-4340-b14d-350854135ba7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:53.042305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbfcffdb-b02f-4340-b14d-350854135ba7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:53.043438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbfcffdb-b02f-4340-b14d-350854135ba7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:53.043880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbfcffdb-b02f-4340-b14d-350854135ba7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:53.123459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cbfcffdb-b02f-4340-b14d-350854135ba7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.096255 Jan 27 16:06:53.124137 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 375/746] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:53 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:53.150494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:53.152193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:53.159150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:53.159880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:53.160747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:53.161432 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:53.201872 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:53.203011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:53.203485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lazy-loading 'fault' on Instance uuid 53c1dfef-ceda-489a-a7ea-045b8ab0f249 {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:06:53.247736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:53.256357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-de8fbd1f-defc-40b1-9fe0-0c277e36351e tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 200 len: 1312 microversion: 2.1 time: 0.110402 Jan 27 16:06:53.257768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 372/747] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:53 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:53.267125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c763a18c-27cc-4b89-94ee-6b223cdf836d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:53.268224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c763a18c-27cc-4b89-94ee-6b223cdf836d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:53.276403 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c763a18c-27cc-4b89-94ee-6b223cdf836d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:53.276848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c763a18c-27cc-4b89-94ee-6b223cdf836d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:53.277633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c763a18c-27cc-4b89-94ee-6b223cdf836d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:53.278063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c763a18c-27cc-4b89-94ee-6b223cdf836d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:53.346336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c763a18c-27cc-4b89-94ee-6b223cdf836d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.088160 Jan 27 16:06:53.350184 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 376/748] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:53 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:54.135529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d7e14d5f-3827-4603-98a4-d1f86a60814e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:54.136540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d7e14d5f-3827-4603-98a4-d1f86a60814e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:54.143572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d7e14d5f-3827-4603-98a4-d1f86a60814e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.144028 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d7e14d5f-3827-4603-98a4-d1f86a60814e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.144829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d7e14d5f-3827-4603-98a4-d1f86a60814e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.145267 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d7e14d5f-3827-4603-98a4-d1f86a60814e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.207177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d7e14d5f-3827-4603-98a4-d1f86a60814e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.075590 Jan 27 16:06:54.207824 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 373/749] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:54 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:54.274475 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:54.275584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: 53c1dfef-ceda-489a-a7ea-045b8ab0f249] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:54.283209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.283723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.284818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.285447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.302295 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] HTTP exception thrown: Instance 53c1dfef-ceda-489a-a7ea-045b8ab0f249 could not be found. Jan 27 16:06:54.302895 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Returning 404 to user: Instance 53c1dfef-ceda-489a-a7ea-045b8ab0f249 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:06:54.303834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1ae9b8e2-44e4-4c2e-b257-4512c5abd45a tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249" status: 404 len: 111 microversion: 2.1 time: 0.033648 Jan 27 16:06:54.304457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 377/750] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:54 2022] GET /compute/v2.1/servers/53c1dfef-ceda-489a-a7ea-045b8ab0f249 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:06:54.313677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:54.314305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:54.323307 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.323763 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.324564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.325001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.351686 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:06:54.362272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4278ddf2-af66-4962-b21f-09b52aa5504a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:54.363399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4278ddf2-af66-4962-b21f-09b52aa5504a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:54.370910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4278ddf2-af66-4962-b21f-09b52aa5504a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.371519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4278ddf2-af66-4962-b21f-09b52aa5504a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.372549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4278ddf2-af66-4962-b21f-09b52aa5504a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.373093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4278ddf2-af66-4962-b21f-09b52aa5504a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.444003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4278ddf2-af66-4962-b21f-09b52aa5504a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.088866 Jan 27 16:06:54.449079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2609649b-81bf-47b5-8afe-d0884aa6551d tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 204 len: 0 microversion: 2.1 time: 0.139621 Jan 27 16:06:54.449667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 374/751] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:06:54 2022] DELETE /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:06:54.450883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 378/752] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:54 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:06:54.458310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:54.459123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:54.466095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.466547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.467365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:54.467804 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:54.601682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:54.609806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-47a3dc66-eacb-468c-9f00-6d1aa703cb1f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.155666 Jan 27 16:06:54.610378 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 375/753] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:54 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:55.220121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4f5a5626-3e3b-4c96-b366-b74e07775d8f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:55.221149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4f5a5626-3e3b-4c96-b366-b74e07775d8f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:55.228169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f5a5626-3e3b-4c96-b366-b74e07775d8f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:55.229244 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f5a5626-3e3b-4c96-b366-b74e07775d8f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:55.230037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f5a5626-3e3b-4c96-b366-b74e07775d8f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:55.230478 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f5a5626-3e3b-4c96-b366-b74e07775d8f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:55.306850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4f5a5626-3e3b-4c96-b366-b74e07775d8f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.090513 Jan 27 16:06:55.307548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 379/754] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:55 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:55.457739 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-76c2b433-e3e1-43eb-a22a-1152fd7b6069 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:55.458804 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-76c2b433-e3e1-43eb-a22a-1152fd7b6069 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:55.465864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-76c2b433-e3e1-43eb-a22a-1152fd7b6069 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:55.466342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-76c2b433-e3e1-43eb-a22a-1152fd7b6069 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:55.467197 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-76c2b433-e3e1-43eb-a22a-1152fd7b6069 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:55.467635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-76c2b433-e3e1-43eb-a22a-1152fd7b6069 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:55.559369 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-76c2b433-e3e1-43eb-a22a-1152fd7b6069 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.105100 Jan 27 16:06:55.560295 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 376/755] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:55 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:55.627133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:55.627824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:55.635461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:55.635912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:55.636705 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:55.637144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:55.767300 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:55.775522 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b2cfcb8b-73ff-439d-9db0-a47f6c648742 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.152050 Jan 27 16:06:55.779013 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 380/756] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:55 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:56.318585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6fd69a6c-23df-44e0-856e-e64b4d752719 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:56.320650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6fd69a6c-23df-44e0-856e-e64b4d752719 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:56.333005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6fd69a6c-23df-44e0-856e-e64b4d752719 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:56.333707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6fd69a6c-23df-44e0-856e-e64b4d752719 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:56.334705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6fd69a6c-23df-44e0-856e-e64b4d752719 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:56.335674 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6fd69a6c-23df-44e0-856e-e64b4d752719 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:56.440436 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6fd69a6c-23df-44e0-856e-e64b4d752719 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.126125 Jan 27 16:06:56.442618 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 377/757] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:56 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:56.572884 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-94df7cbe-5e0b-4a7e-91e4-49cbe1f555a1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:56.573797 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-94df7cbe-5e0b-4a7e-91e4-49cbe1f555a1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:56.580502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-94df7cbe-5e0b-4a7e-91e4-49cbe1f555a1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:56.581088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-94df7cbe-5e0b-4a7e-91e4-49cbe1f555a1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:56.581970 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-94df7cbe-5e0b-4a7e-91e4-49cbe1f555a1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:56.582477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-94df7cbe-5e0b-4a7e-91e4-49cbe1f555a1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:56.658257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-94df7cbe-5e0b-4a7e-91e4-49cbe1f555a1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.089308 Jan 27 16:06:56.659098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 381/758] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:56 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:56.791262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:56.791953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:56.798737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:56.799215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:56.799997 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:56.800434 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:56.935086 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:56.942713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-82ccf617-95fc-4c78-81e4-700ea747ae4f tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.155481 Jan 27 16:06:56.943315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 378/759] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:56 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:57.452657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c3a7f050-6e21-4039-af99-8659eef559e0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:57.453647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c3a7f050-6e21-4039-af99-8659eef559e0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:57.460457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3a7f050-6e21-4039-af99-8659eef559e0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:57.460906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3a7f050-6e21-4039-af99-8659eef559e0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:57.461688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3a7f050-6e21-4039-af99-8659eef559e0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:57.462118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3a7f050-6e21-4039-af99-8659eef559e0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:57.560022 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c3a7f050-6e21-4039-af99-8659eef559e0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.111054 Jan 27 16:06:57.560753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 382/760] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:57 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:57.669363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d59a112a-254b-43d4-9ea3-81a2ccccdd83 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:57.670276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d59a112a-254b-43d4-9ea3-81a2ccccdd83 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:57.677011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d59a112a-254b-43d4-9ea3-81a2ccccdd83 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:57.677760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d59a112a-254b-43d4-9ea3-81a2ccccdd83 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:57.678684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d59a112a-254b-43d4-9ea3-81a2ccccdd83 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:57.679393 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d59a112a-254b-43d4-9ea3-81a2ccccdd83 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:57.765854 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d59a112a-254b-43d4-9ea3-81a2ccccdd83 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.099798 Jan 27 16:06:57.766875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 379/761] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:57 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:57.959902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:57.962272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:57.969404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:57.969855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:57.970845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:57.971322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:58.118406 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:58.125697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c9d6cb28-8ffe-4977-8963-0ccb57f3f9f3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.169799 Jan 27 16:06:58.126254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 383/762] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:57 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:58.576914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-40454cc9-e5d9-4856-ad87-dc87be66adaa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:58.578822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-40454cc9-e5d9-4856-ad87-dc87be66adaa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:58.587143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40454cc9-e5d9-4856-ad87-dc87be66adaa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:58.587608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40454cc9-e5d9-4856-ad87-dc87be66adaa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:58.588397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40454cc9-e5d9-4856-ad87-dc87be66adaa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:58.588924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40454cc9-e5d9-4856-ad87-dc87be66adaa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:58.665105 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-40454cc9-e5d9-4856-ad87-dc87be66adaa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.095384 Jan 27 16:06:58.666367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 380/763] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:58 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:06:58.778166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-768ac88b-5e19-4a8d-834d-350fc1b9caff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:58.779118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-768ac88b-5e19-4a8d-834d-350fc1b9caff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:58.786604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-768ac88b-5e19-4a8d-834d-350fc1b9caff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:58.787151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-768ac88b-5e19-4a8d-834d-350fc1b9caff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:58.787984 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-768ac88b-5e19-4a8d-834d-350fc1b9caff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:58.788471 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-768ac88b-5e19-4a8d-834d-350fc1b9caff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:58.856822 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-768ac88b-5e19-4a8d-834d-350fc1b9caff tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.082650 Jan 27 16:06:58.857698 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 384/764] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:58 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:06:59.142465 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:06:59.143364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:59.151894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:59.152353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:59.153181 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:59.153672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:59.304323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:06:59.312222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9f82becf-7c80-436a-b67b-b1624aaceac8 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.174109 Jan 27 16:06:59.312793 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 381/765] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:06:59 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:06:59.678357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-379bd5d6-ecc7-4136-8c56-2eb14aad4206 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:59.679525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-379bd5d6-ecc7-4136-8c56-2eb14aad4206 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:59.686793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-379bd5d6-ecc7-4136-8c56-2eb14aad4206 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:59.687270 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-379bd5d6-ecc7-4136-8c56-2eb14aad4206 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:59.688063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-379bd5d6-ecc7-4136-8c56-2eb14aad4206 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:59.688499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-379bd5d6-ecc7-4136-8c56-2eb14aad4206 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:59.754574 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-379bd5d6-ecc7-4136-8c56-2eb14aad4206 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.080235 Jan 27 16:06:59.755253 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 385/766] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:06:59 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:06:59.869321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-78721b6a-7440-444f-b077-dc3f80d1e5fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:06:59.870294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-78721b6a-7440-444f-b077-dc3f80d1e5fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:06:59.876882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78721b6a-7440-444f-b077-dc3f80d1e5fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:59.877333 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78721b6a-7440-444f-b077-dc3f80d1e5fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:59.878164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78721b6a-7440-444f-b077-dc3f80d1e5fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:06:59.878938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-78721b6a-7440-444f-b077-dc3f80d1e5fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:06:59.949244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-78721b6a-7440-444f-b077-dc3f80d1e5fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.084008 Jan 27 16:06:59.951343 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 382/767] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:06:59 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:00.329843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:00.330664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:00.338524 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:00.339097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:00.339996 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:00.340443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:00.483994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:00.492145 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b9460fbb-c9c3-42be-b2e4-4cb0b3dd9f36 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1520 microversion: 2.1 time: 0.166235 Jan 27 16:07:00.492976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 386/768] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:00 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:00.766232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-abe8ce03-7722-4369-ae58-879bdc699478 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:00.767324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-abe8ce03-7722-4369-ae58-879bdc699478 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:00.774174 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abe8ce03-7722-4369-ae58-879bdc699478 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:00.774631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abe8ce03-7722-4369-ae58-879bdc699478 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:00.775527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abe8ce03-7722-4369-ae58-879bdc699478 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:00.775968 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-abe8ce03-7722-4369-ae58-879bdc699478 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:00.854345 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-abe8ce03-7722-4369-ae58-879bdc699478 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 28808 microversion: 2.20 time: 0.091906 Jan 27 16:07:00.855983 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 383/769] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:00 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 28808 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:00.960367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3d18ad3d-0242-43dc-98db-01af44a79c56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:00.961925 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3d18ad3d-0242-43dc-98db-01af44a79c56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:00.968802 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d18ad3d-0242-43dc-98db-01af44a79c56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:00.969691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d18ad3d-0242-43dc-98db-01af44a79c56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:00.970387 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d18ad3d-0242-43dc-98db-01af44a79c56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:00.970828 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3d18ad3d-0242-43dc-98db-01af44a79c56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:01.045870 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3d18ad3d-0242-43dc-98db-01af44a79c56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.088864 Jan 27 16:07:01.046706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 387/770] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:00 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:01.401032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-2d8ec38d-8316-4ce7-9c89-dc80bfadd40d req-9d3bfdb7-a3cf-48d8-8967-5659640d7a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56702b3-830c-441b-b790-b13f42d20c0d", "name": "network-vif-deleted", "tag": "fdc1784f-018f-4bdb-9f4c-28700d25817c"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:01.403090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:07:01.403090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:07:01.412774 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2d8ec38d-8316-4ce7-9c89-dc80bfadd40d req-9d3bfdb7-a3cf-48d8-8967-5659640d7a0e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:01.413484 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2d8ec38d-8316-4ce7-9c89-dc80bfadd40d req-9d3bfdb7-a3cf-48d8-8967-5659640d7a0e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:01.426512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-2d8ec38d-8316-4ce7-9c89-dc80bfadd40d req-9d3bfdb7-a3cf-48d8-8967-5659640d7a0e service nova] Creating event network-vif-deleted:fdc1784f-018f-4bdb-9f4c-28700d25817c for instance e56702b3-830c-441b-b790-b13f42d20c0d on hv-cinder-82635 Jan 27 16:07:01.433945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-2d8ec38d-8316-4ce7-9c89-dc80bfadd40d req-9d3bfdb7-a3cf-48d8-8967-5659640d7a0e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036653 Jan 27 16:07:01.434569 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 384/771] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:07:01.510838 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:01.512093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:01.520162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:01.521113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:01.521970 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:01.522419 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:01.559674 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:01.560404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:01.560855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lazy-loading 'fault' on Instance uuid e56702b3-830c-441b-b790-b13f42d20c0d {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:07:01.611735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c733accb508546dd9c89a037208d4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2429eb90c34664ac6a690662ded8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:01.620410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d4168dba-26ae-42b1-8c61-087a0182fae3 tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 200 len: 1311 microversion: 2.1 time: 0.114405 Jan 27 16:07:01.621816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 388/772] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:01 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:01.871926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-88922d4f-3721-4b5b-bb5c-8499752a2691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:01.876299 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-88922d4f-3721-4b5b-bb5c-8499752a2691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:01.890323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88922d4f-3721-4b5b-bb5c-8499752a2691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:01.891121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88922d4f-3721-4b5b-bb5c-8499752a2691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:01.892768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88922d4f-3721-4b5b-bb5c-8499752a2691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:01.893575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88922d4f-3721-4b5b-bb5c-8499752a2691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:02.002732 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-88922d4f-3721-4b5b-bb5c-8499752a2691 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 29931 microversion: 2.20 time: 0.139026 Jan 27 16:07:02.008399 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 385/773] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:01 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 29931 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:02.059182 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5bfb4943-3248-4994-ba29-9a802687ae74 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:02.061260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5bfb4943-3248-4994-ba29-9a802687ae74 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:02.069391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bfb4943-3248-4994-ba29-9a802687ae74 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:02.070683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bfb4943-3248-4994-ba29-9a802687ae74 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:02.071823 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bfb4943-3248-4994-ba29-9a802687ae74 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:02.072368 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bfb4943-3248-4994-ba29-9a802687ae74 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:02.137453 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5bfb4943-3248-4994-ba29-9a802687ae74 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 28532 microversion: 2.1 time: 0.082415 Jan 27 16:07:02.138260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 389/774] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:02 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 28532 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:02.640222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:02.640968 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] [instance: e56702b3-830c-441b-b790-b13f42d20c0d] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:02.647965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:02.648488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:02.649201 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:02.650170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:02.667925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] HTTP exception thrown: Instance e56702b3-830c-441b-b790-b13f42d20c0d could not be found. Jan 27 16:07:02.668741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] Returning 404 to user: Instance e56702b3-830c-441b-b790-b13f42d20c0d could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:07:02.669576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e3cf0172-843d-4e5f-89a6-0567f5d13f0c tempest-ServerRescueNegativeTestJSON-563805037 tempest-ServerRescueNegativeTestJSON-563805037-project] 10.222.0.61 "GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d" status: 404 len: 111 microversion: 2.1 time: 0.033389 Jan 27 16:07:02.670131 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 386/775] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:02 2022] GET /compute/v2.1/servers/e56702b3-830c-441b-b790-b13f42d20c0d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:07:03.021494 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dcabcf87-5c1e-4374-a750-77cc078d625c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:03.023480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dcabcf87-5c1e-4374-a750-77cc078d625c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:03.032134 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcabcf87-5c1e-4374-a750-77cc078d625c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:03.033456 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcabcf87-5c1e-4374-a750-77cc078d625c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:03.035109 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcabcf87-5c1e-4374-a750-77cc078d625c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:03.036064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dcabcf87-5c1e-4374-a750-77cc078d625c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:03.121625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dcabcf87-5c1e-4374-a750-77cc078d625c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 31896 microversion: 2.20 time: 0.107185 Jan 27 16:07:03.122349 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 390/776] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:03 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 31896 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:03.150813 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9496eab7-3df5-4b03-9bfc-5791faf48e7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:03.152221 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9496eab7-3df5-4b03-9bfc-5791faf48e7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:03.160390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9496eab7-3df5-4b03-9bfc-5791faf48e7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:03.161004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9496eab7-3df5-4b03-9bfc-5791faf48e7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:03.161785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9496eab7-3df5-4b03-9bfc-5791faf48e7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:03.162403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9496eab7-3df5-4b03-9bfc-5791faf48e7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:03.252749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9496eab7-3df5-4b03-9bfc-5791faf48e7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 29081 microversion: 2.1 time: 0.106776 Jan 27 16:07:03.261507 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 387/777] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:03 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 29081 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:04.137756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3ab9283a-c24c-4a9c-979e-9fa30c26648e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:04.138965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3ab9283a-c24c-4a9c-979e-9fa30c26648e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:04.147004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3ab9283a-c24c-4a9c-979e-9fa30c26648e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:04.147740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3ab9283a-c24c-4a9c-979e-9fa30c26648e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:04.148804 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3ab9283a-c24c-4a9c-979e-9fa30c26648e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:04.150422 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3ab9283a-c24c-4a9c-979e-9fa30c26648e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:04.230688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3ab9283a-c24c-4a9c-979e-9fa30c26648e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 33250 microversion: 2.20 time: 0.097313 Jan 27 16:07:04.232298 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 391/778] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:04 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 33250 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:04.267371 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d0b6b2e3-7406-46d3-9b40-2390cd970a60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:04.268572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d0b6b2e3-7406-46d3-9b40-2390cd970a60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:04.277431 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b6b2e3-7406-46d3-9b40-2390cd970a60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:04.277962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b6b2e3-7406-46d3-9b40-2390cd970a60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:04.278941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b6b2e3-7406-46d3-9b40-2390cd970a60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:04.279532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b6b2e3-7406-46d3-9b40-2390cd970a60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:04.383464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d0b6b2e3-7406-46d3-9b40-2390cd970a60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 30959 microversion: 2.1 time: 0.121019 Jan 27 16:07:04.384169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 388/779] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:04 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 30959 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:05.244966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-41dabd11-bccb-4e40-97a2-e66d14973ca2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:05.247673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-41dabd11-bccb-4e40-97a2-e66d14973ca2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:05.260227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41dabd11-bccb-4e40-97a2-e66d14973ca2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:05.261376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41dabd11-bccb-4e40-97a2-e66d14973ca2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:05.262779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41dabd11-bccb-4e40-97a2-e66d14973ca2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:05.263272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-41dabd11-bccb-4e40-97a2-e66d14973ca2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:05.357043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-41dabd11-bccb-4e40-97a2-e66d14973ca2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 33899 microversion: 2.20 time: 0.117538 Jan 27 16:07:05.357917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 392/780] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:05 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 33899 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:05.396107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cb2d4034-25e5-4d54-be75-48f6ce18074c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:05.397166 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cb2d4034-25e5-4d54-be75-48f6ce18074c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:05.408620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb2d4034-25e5-4d54-be75-48f6ce18074c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:05.409825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb2d4034-25e5-4d54-be75-48f6ce18074c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:05.410806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb2d4034-25e5-4d54-be75-48f6ce18074c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:05.411818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb2d4034-25e5-4d54-be75-48f6ce18074c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:05.501049 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cb2d4034-25e5-4d54-be75-48f6ce18074c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 32337 microversion: 2.1 time: 0.108194 Jan 27 16:07:05.502552 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 389/781] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:05 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 32337 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:05.588078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-600994465", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "9564f5ab-b5b0-4731-93e1-698de8676e63"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:05.639946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] validate_networks() for [('9564f5ab-b5b0-4731-93e1-698de8676e63', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:07:06.085898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:07:06.086322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:07:06.086824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:07:06.087896 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:07:06.088309 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:07:06.097194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:06.097718 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:06.098607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:06.099175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:06.115819 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Getting quotas for project 9f9b239b5a37482a93c714c4cff8d675. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:07:06.120602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Getting quotas for user 938fbc3632a84ce88d5ecb42681ada96 and project 9f9b239b5a37482a93c714c4cff8d675. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:07:06.131145 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:07:06.133545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:07:06.178075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-15c288f9-dff7-4046-8f6d-5fee52c6d8fd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594440 Jan 27 16:07:06.178797 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 393/782] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:07:06.188831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3f4fc221-99be-468d-9ab0-b87b5ff4ca1e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:06.189524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3f4fc221-99be-468d-9ab0-b87b5ff4ca1e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:06.289094 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3f4fc221-99be-468d-9ab0-b87b5ff4ca1e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:06.297560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3f4fc221-99be-468d-9ab0-b87b5ff4ca1e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1218 microversion: 2.1 time: 0.112517 Jan 27 16:07:06.298115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 390/783] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:06 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:07:06.370050 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-331c6c11-bd7e-4afe-887a-30a53a895297 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:06.371113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-331c6c11-bd7e-4afe-887a-30a53a895297 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:06.392663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-331c6c11-bd7e-4afe-887a-30a53a895297 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:06.397812 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-331c6c11-bd7e-4afe-887a-30a53a895297 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:06.405000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-331c6c11-bd7e-4afe-887a-30a53a895297 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:06.405504 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-331c6c11-bd7e-4afe-887a-30a53a895297 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:06.504304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-331c6c11-bd7e-4afe-887a-30a53a895297 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 35053 microversion: 2.20 time: 0.138566 Jan 27 16:07:06.505282 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 394/784] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:06 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 35053 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:06.516169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-aa206fab-64b5-4b78-b95f-95d475d21be2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:06.518291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-aa206fab-64b5-4b78-b95f-95d475d21be2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:06.529399 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa206fab-64b5-4b78-b95f-95d475d21be2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:06.530114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa206fab-64b5-4b78-b95f-95d475d21be2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:06.531448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa206fab-64b5-4b78-b95f-95d475d21be2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:06.532162 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa206fab-64b5-4b78-b95f-95d475d21be2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:06.625107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-aa206fab-64b5-4b78-b95f-95d475d21be2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 33388 microversion: 2.1 time: 0.114189 Jan 27 16:07:06.625740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 391/785] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:06 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 33388 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:07:07.314453 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:07.315272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:07.322573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:07.323226 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:07.324095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:07.324620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:07.417936 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:07.429846 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-47938030-dabb-4a13-9fe1-2626aaaf1288 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1278 microversion: 2.1 time: 0.119244 Jan 27 16:07:07.430573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 395/786] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:07 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:07.519240 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c14ebb0d-1b64-4a97-a49c-dcfe3d6b65e8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:07.520685 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c14ebb0d-1b64-4a97-a49c-dcfe3d6b65e8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:07.528721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c14ebb0d-1b64-4a97-a49c-dcfe3d6b65e8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:07.537003 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c14ebb0d-1b64-4a97-a49c-dcfe3d6b65e8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:07.538041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c14ebb0d-1b64-4a97-a49c-dcfe3d6b65e8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:07.538550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c14ebb0d-1b64-4a97-a49c-dcfe3d6b65e8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:07.637482 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c14ebb0d-1b64-4a97-a49c-dcfe3d6b65e8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 35840 microversion: 2.20 time: 0.122882 Jan 27 16:07:07.638104 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 392/787] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:07 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 35840 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:07.638919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4acafb98-1ce5-47ca-8153-9d290fe06eaf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:07.640385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4acafb98-1ce5-47ca-8153-9d290fe06eaf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:07.647689 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4acafb98-1ce5-47ca-8153-9d290fe06eaf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:07.648577 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4acafb98-1ce5-47ca-8153-9d290fe06eaf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:07.649433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4acafb98-1ce5-47ca-8153-9d290fe06eaf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:07.649948 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4acafb98-1ce5-47ca-8153-9d290fe06eaf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:07.745198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4acafb98-1ce5-47ca-8153-9d290fe06eaf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 34090 microversion: 2.1 time: 0.109870 Jan 27 16:07:07.745979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 396/788] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:07 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 34090 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:07:08.449935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:08.450642 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:08.458294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:08.458918 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:08.459721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:08.460152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:08.651201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-05c7e8be-b705-405d-90de-237e68b40d86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:08.653750 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-05c7e8be-b705-405d-90de-237e68b40d86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:08.664581 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05c7e8be-b705-405d-90de-237e68b40d86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:08.666346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05c7e8be-b705-405d-90de-237e68b40d86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:08.667948 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05c7e8be-b705-405d-90de-237e68b40d86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:08.668633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05c7e8be-b705-405d-90de-237e68b40d86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:08.759657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-05c7e8be-b705-405d-90de-237e68b40d86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 37095 microversion: 2.20 time: 0.112849 Jan 27 16:07:08.760410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 397/789] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:08 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 37095 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:07:08.765784 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a1763b89-b4ca-4b54-a2f8-a6db19689ecc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:08.766883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a1763b89-b4ca-4b54-a2f8-a6db19689ecc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:08.773835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a1763b89-b4ca-4b54-a2f8-a6db19689ecc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:08.774443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a1763b89-b4ca-4b54-a2f8-a6db19689ecc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:08.775848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a1763b89-b4ca-4b54-a2f8-a6db19689ecc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:08.776349 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a1763b89-b4ca-4b54-a2f8-a6db19689ecc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:08.853585 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a1763b89-b4ca-4b54-a2f8-a6db19689ecc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 35050 microversion: 2.1 time: 0.090800 Jan 27 16:07:08.854268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 398/790] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:08 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 35050 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:08.957297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:08.966082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-970d5c67-1115-4a1d-a379-c56f8d7ac286 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.520052 Jan 27 16:07:08.967343 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 393/791] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:08 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:09.075427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-1c953fe1-3f2c-4567-907a-810a82327707 req-2621b5c7-0294-4e12-aa55-55d577198478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89638f5a-769c-4331-b562-58ebf191dc46", "tag": "50d3b018-cc7a-4148-b6b4-82c83bfdfd59"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:09.076942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:07:09.076942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:07:09.090469 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-1c953fe1-3f2c-4567-907a-810a82327707 req-2621b5c7-0294-4e12-aa55-55d577198478 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:09.091112 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-1c953fe1-3f2c-4567-907a-810a82327707 req-2621b5c7-0294-4e12-aa55-55d577198478 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:09.103505 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-1c953fe1-3f2c-4567-907a-810a82327707 req-2621b5c7-0294-4e12-aa55-55d577198478 service nova] Creating event network-changed:50d3b018-cc7a-4148-b6b4-82c83bfdfd59 for instance 89638f5a-769c-4331-b562-58ebf191dc46 on hv-cinder-82635 Jan 27 16:07:09.108572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-1c953fe1-3f2c-4567-907a-810a82327707 req-2621b5c7-0294-4e12-aa55-55d577198478 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037178 Jan 27 16:07:09.109627 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 399/792] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:07:09.771489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1b988874-c8f8-4494-8e27-0470f9c683af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:09.772749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1b988874-c8f8-4494-8e27-0470f9c683af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:09.782403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b988874-c8f8-4494-8e27-0470f9c683af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:09.783376 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b988874-c8f8-4494-8e27-0470f9c683af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:09.784399 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b988874-c8f8-4494-8e27-0470f9c683af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:09.785075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b988874-c8f8-4494-8e27-0470f9c683af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:09.867643 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ddc298f0-078e-4973-b952-cec875b79407 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:09.869280 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ddc298f0-078e-4973-b952-cec875b79407 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:09.874750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1b988874-c8f8-4494-8e27-0470f9c683af tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 38365 microversion: 2.20 time: 0.106755 Jan 27 16:07:09.876204 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ddc298f0-078e-4973-b952-cec875b79407 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:09.876721 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ddc298f0-078e-4973-b952-cec875b79407 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:09.877754 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ddc298f0-078e-4973-b952-cec875b79407 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:09.878402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ddc298f0-078e-4973-b952-cec875b79407 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:09.883772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 394/793] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:09 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 38365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:09.962162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ddc298f0-078e-4973-b952-cec875b79407 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 36199 microversion: 2.1 time: 0.098776 Jan 27 16:07:09.963714 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 400/794] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:09 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 36199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:07:09.984155 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:09.984845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:09.991869 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:09.992584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:09.993364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:09.993961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:10.241260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:10.248995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-58301995-7697-4c43-b994-b7caf3a3bd45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.268747 Jan 27 16:07:10.249560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 395/795] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:09 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:10.890638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7edd247d-f1d9-4e30-8c56-616c64b15dd6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:10.891727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7edd247d-f1d9-4e30-8c56-616c64b15dd6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:10.898532 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7edd247d-f1d9-4e30-8c56-616c64b15dd6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:10.899044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7edd247d-f1d9-4e30-8c56-616c64b15dd6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:10.899786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7edd247d-f1d9-4e30-8c56-616c64b15dd6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:10.900220 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7edd247d-f1d9-4e30-8c56-616c64b15dd6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:10.974830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-20dfa246-45c0-4c0e-aba5-91f910a24d84 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:10.975783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-20dfa246-45c0-4c0e-aba5-91f910a24d84 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:10.982579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20dfa246-45c0-4c0e-aba5-91f910a24d84 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:10.982579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20dfa246-45c0-4c0e-aba5-91f910a24d84 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:10.983245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20dfa246-45c0-4c0e-aba5-91f910a24d84 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:10.983684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20dfa246-45c0-4c0e-aba5-91f910a24d84 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:11.031437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7edd247d-f1d9-4e30-8c56-616c64b15dd6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 38365 microversion: 2.20 time: 0.144543 Jan 27 16:07:11.036311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 401/796] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:10 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 38365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:11.059475 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-20dfa246-45c0-4c0e-aba5-91f910a24d84 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 37680 microversion: 2.1 time: 0.087944 Jan 27 16:07:11.060310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 396/797] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:10 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 37680 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:07:11.266139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:11.266852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:11.273830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:11.274475 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:11.275477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:11.275913 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:11.424104 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:11.433135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-43274450-9f14-41a2-9ade-600568e16e4c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.171103 Jan 27 16:07:11.434349 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 402/798] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:11 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:12.044532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-660b47fb-9707-497d-a8fd-0f85a335fe10 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:12.045460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-660b47fb-9707-497d-a8fd-0f85a335fe10 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:12.052278 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-660b47fb-9707-497d-a8fd-0f85a335fe10 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:12.052722 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-660b47fb-9707-497d-a8fd-0f85a335fe10 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:12.053496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-660b47fb-9707-497d-a8fd-0f85a335fe10 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:12.053923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-660b47fb-9707-497d-a8fd-0f85a335fe10 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:12.072064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-78514ce8-0333-413f-94a8-395137950392 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:12.074030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-78514ce8-0333-413f-94a8-395137950392 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:12.080213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-78514ce8-0333-413f-94a8-395137950392 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:12.080663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-78514ce8-0333-413f-94a8-395137950392 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:12.081457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-78514ce8-0333-413f-94a8-395137950392 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:12.081956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-78514ce8-0333-413f-94a8-395137950392 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:12.118252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-660b47fb-9707-497d-a8fd-0f85a335fe10 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 38365 microversion: 2.20 time: 0.076711 Jan 27 16:07:12.119009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 397/799] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:12 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 38365 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:12.159222 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-78514ce8-0333-413f-94a8-395137950392 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 38051 microversion: 2.1 time: 0.091462 Jan 27 16:07:12.159856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 403/800] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:12 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 38051 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:07:12.450496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:12.451245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:12.458022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:12.458476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:12.459272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:12.459721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:12.590088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:12.597653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f076ab11-2465-4040-8332-12a8d5ad52bd tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.151756 Jan 27 16:07:12.598208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 398/801] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:12 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:13.131143 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-88cefc40-3d83-4b55-8fe5-c4707572bfbb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:13.132194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-88cefc40-3d83-4b55-8fe5-c4707572bfbb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:13.139935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-88cefc40-3d83-4b55-8fe5-c4707572bfbb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:13.140401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-88cefc40-3d83-4b55-8fe5-c4707572bfbb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:13.141239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-88cefc40-3d83-4b55-8fe5-c4707572bfbb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:13.141697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-88cefc40-3d83-4b55-8fe5-c4707572bfbb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:13.172107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f611d444-0347-42a3-8633-4d510223de6b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:13.173090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f611d444-0347-42a3-8633-4d510223de6b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:13.179735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f611d444-0347-42a3-8633-4d510223de6b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:13.180234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f611d444-0347-42a3-8633-4d510223de6b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:13.181069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f611d444-0347-42a3-8633-4d510223de6b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:13.181505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f611d444-0347-42a3-8633-4d510223de6b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:15.353644 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-88cefc40-3d83-4b55-8fe5-c4707572bfbb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 38365 microversion: 2.20 time: 2.226687 Jan 27 16:07:15.354410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 404/802] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:13 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 38365 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:15.359437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:15.360132 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:15.361992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f611d444-0347-42a3-8633-4d510223de6b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 38051 microversion: 2.1 time: 2.193712 Jan 27 16:07:15.366170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 399/803] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:13 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 38051 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:07:15.376440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:15.376908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:15.377726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:15.378170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:15.504910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:15.513368 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2d7cd524-6372-44ce-b9e4-6b7595fadca8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.157791 Jan 27 16:07:15.513929 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 405/804] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:15 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:16.368494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3dace3e7-2467-4c38-b3d2-98c3ea31c859 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:16.369693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3dace3e7-2467-4c38-b3d2-98c3ea31c859 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:16.374169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a89de7ef-d2aa-4cdb-967b-52756b8d8b61 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:16.375126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a89de7ef-d2aa-4cdb-967b-52756b8d8b61 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:16.377156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3dace3e7-2467-4c38-b3d2-98c3ea31c859 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:16.377660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3dace3e7-2467-4c38-b3d2-98c3ea31c859 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:16.378670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3dace3e7-2467-4c38-b3d2-98c3ea31c859 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:16.379165 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3dace3e7-2467-4c38-b3d2-98c3ea31c859 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:16.381773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a89de7ef-d2aa-4cdb-967b-52756b8d8b61 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:16.382224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a89de7ef-d2aa-4cdb-967b-52756b8d8b61 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:16.383084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a89de7ef-d2aa-4cdb-967b-52756b8d8b61 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:16.383524 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a89de7ef-d2aa-4cdb-967b-52756b8d8b61 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:16.454562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a89de7ef-d2aa-4cdb-967b-52756b8d8b61 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 38051 microversion: 2.1 time: 0.083780 Jan 27 16:07:16.458602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 406/805] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:16 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 38051 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:07:16.458749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3dace3e7-2467-4c38-b3d2-98c3ea31c859 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 38365 microversion: 2.20 time: 0.095043 Jan 27 16:07:16.458749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 400/806] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:16 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 38365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:07:16.530450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:16.531173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:16.538022 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:16.538474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:16.539827 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:16.540278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:16.674347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:16.681520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9282900e-8daf-415b-a1d1-9f60f6d668d9 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.155414 Jan 27 16:07:16.682078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 407/807] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:16 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:17.467295 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0ba275f9-83d7-44b3-9d24-71db0b578b2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:17.468326 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0ba275f9-83d7-44b3-9d24-71db0b578b2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:17.470007 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-54506f05-b66c-4bbc-a31c-5b0894d29b99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:17.470736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-54506f05-b66c-4bbc-a31c-5b0894d29b99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:17.475912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0ba275f9-83d7-44b3-9d24-71db0b578b2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.476360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0ba275f9-83d7-44b3-9d24-71db0b578b2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.477772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0ba275f9-83d7-44b3-9d24-71db0b578b2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.478204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0ba275f9-83d7-44b3-9d24-71db0b578b2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.479903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54506f05-b66c-4bbc-a31c-5b0894d29b99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.480472 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54506f05-b66c-4bbc-a31c-5b0894d29b99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.481977 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54506f05-b66c-4bbc-a31c-5b0894d29b99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.482443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54506f05-b66c-4bbc-a31c-5b0894d29b99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.565808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0ba275f9-83d7-44b3-9d24-71db0b578b2e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 38068 microversion: 2.1 time: 0.102889 Jan 27 16:07:17.566806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 401/808] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:17 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 38068 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:17.592933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-54506f05-b66c-4bbc-a31c-5b0894d29b99 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 200 len: 38508 microversion: 2.20 time: 0.126766 Jan 27 16:07:17.593699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 408/809] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:17 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 38508 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:07:17.605948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4812c83b-5b90-4567-b51b-1419a870e969 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:17.606591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4812c83b-5b90-4567-b51b-1419a870e969 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:17.614198 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4812c83b-5b90-4567-b51b-1419a870e969 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.614643 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4812c83b-5b90-4567-b51b-1419a870e969 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.615942 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4812c83b-5b90-4567-b51b-1419a870e969 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.616391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4812c83b-5b90-4567-b51b-1419a870e969 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.645717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4812c83b-5b90-4567-b51b-1419a870e969 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/ips" status: 200 len: 150 microversion: 2.20 time: 0.044908 Jan 27 16:07:17.646335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 402/810] 10.222.0.61 () {60 vars in 1288 bytes} [Thu Jan 27 16:07:17 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:17.698284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:17.699286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:17.706926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.707601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.708495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.709153 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.715474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-35d80736-bd84-461b-95d6-d01cb1f59c1a req-09c9ff9c-e6b6-4b89-85f4-917f49c71c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89638f5a-769c-4331-b562-58ebf191dc46", "name": "network-vif-plugged", "status": "completed", "tag": "50d3b018-cc7a-4148-b6b4-82c83bfdfd59"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:17.717030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:07:17.717030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:07:17.724816 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-35d80736-bd84-461b-95d6-d01cb1f59c1a req-09c9ff9c-e6b6-4b89-85f4-917f49c71c40 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:17.725502 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-35d80736-bd84-461b-95d6-d01cb1f59c1a req-09c9ff9c-e6b6-4b89-85f4-917f49c71c40 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:17.738578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-35d80736-bd84-461b-95d6-d01cb1f59c1a req-09c9ff9c-e6b6-4b89-85f4-917f49c71c40 service nova] Creating event network-vif-plugged:50d3b018-cc7a-4148-b6b4-82c83bfdfd59 for instance 89638f5a-769c-4331-b562-58ebf191dc46 on hv-cinder-82635 Jan 27 16:07:17.744290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-35d80736-bd84-461b-95d6-d01cb1f59c1a req-09c9ff9c-e6b6-4b89-85f4-917f49c71c40 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Jan 27 16:07:17.745171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 403/811] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:07:17.874385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:17.883521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a7a01d18-b371-465c-97f1-c62e5b5cc1f8 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.188915 Jan 27 16:07:17.884112 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 409/812] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:17 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:18.579841 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1964dc5a-d58f-4e9f-ae96-3d3e0349f41c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:18.581033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1964dc5a-d58f-4e9f-ae96-3d3e0349f41c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:18.587994 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1964dc5a-d58f-4e9f-ae96-3d3e0349f41c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:18.588585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1964dc5a-d58f-4e9f-ae96-3d3e0349f41c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:18.589481 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1964dc5a-d58f-4e9f-ae96-3d3e0349f41c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:18.590028 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1964dc5a-d58f-4e9f-ae96-3d3e0349f41c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:18.717078 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1964dc5a-d58f-4e9f-ae96-3d3e0349f41c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 200 len: 38180 microversion: 2.1 time: 0.142047 Jan 27 16:07:18.717731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 404/813] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:18 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 38180 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:07:18.727875 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-75b0a31a-9bce-4ef9-8f8c-c3e743ac786e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:18.728423 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-75b0a31a-9bce-4ef9-8f8c-c3e743ac786e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:18.735156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75b0a31a-9bce-4ef9-8f8c-c3e743ac786e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:18.735672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75b0a31a-9bce-4ef9-8f8c-c3e743ac786e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:18.736460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75b0a31a-9bce-4ef9-8f8c-c3e743ac786e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:18.736893 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75b0a31a-9bce-4ef9-8f8c-c3e743ac786e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:18.762371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-75b0a31a-9bce-4ef9-8f8c-c3e743ac786e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/ips" status: 200 len: 145 microversion: 2.1 time: 0.038455 Jan 27 16:07:18.762938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 410/814] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jan 27 16:07:18 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:07:18.900716 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:18.901412 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:18.908334 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:18.908789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:18.909588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:18.910026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:19.052322 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:19.060417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-37c1a48d-0fc2-493f-bd11-99dd859bd8e5 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1318 microversion: 2.1 time: 0.163711 Jan 27 16:07:19.060978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 405/815] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:18 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:19.975093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:19.975787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:19.983654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:19.984101 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:19.985117 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:19.985901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:20.014057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lazy-loading 'flavor' on Instance uuid ffb168b3-a714-4f0b-aca9-d23922390178 {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:07:20.077912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:20.079217 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:20.088822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:20.089731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:20.090849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:20.092055 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:20.258933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:20.271823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-66a529f6-2972-4700-9fe7-a0a43b890a60 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1507 microversion: 2.1 time: 0.197498 Jan 27 16:07:20.272838 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 406/816] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:20 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:20.472354 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-77972db1-fbf9-4e18-b3f1-3f2dc88157a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 202 len: 0 microversion: 2.20 time: 0.501013 Jan 27 16:07:20.473084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 411/817] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:07:19 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:07:20.484175 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:20.485036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:20.494177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:20.494871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:20.495908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:20.496395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:20.660142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:20.668606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:20.670290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:20.671744 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f614c18d-60eb-4ad1-84d6-b46752d30c24 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.192719 Jan 27 16:07:20.683282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 407/818] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:20 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:21.692772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:21.693540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:21.700718 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:21.701203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:21.702266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:21.702770 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:21.858559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:21.866180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:21.868508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:21.869651 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8a54a032-b2b3-4a1b-b453-194c50ea7eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.182337 Jan 27 16:07:21.870202 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 412/819] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:21 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:22.466890 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cc9f6d6d-b532-41fc-b62a-4406468ff734 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8a0b4a3-e8c1-4038-aa19-d5a559b30dd2"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:22.468099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cc9f6d6d-b532-41fc-b62a-4406468ff734 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:22.474542 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cc9f6d6d-b532-41fc-b62a-4406468ff734 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:22.475004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cc9f6d6d-b532-41fc-b62a-4406468ff734 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:22.475811 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cc9f6d6d-b532-41fc-b62a-4406468ff734 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:22.476245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cc9f6d6d-b532-41fc-b62a-4406468ff734 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:22.780124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cc9f6d6d-b532-41fc-b62a-4406468ff734 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316655 Jan 27 16:07:22.780829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 408/820] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:07:22 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:07:22.889650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:22.890939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:22.899003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:22.899768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:22.901169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:22.901604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:23.061266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:23.072624 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:23.074284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:23.075494 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bd8edfb6-67fa-4bab-a160-26e3cf5a0336 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.189806 Jan 27 16:07:23.076130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 413/821] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:22 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:24.095416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:24.096232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:24.104460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:24.105059 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:24.106041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:24.106662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:24.266579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:24.276104 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:24.277697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:24.279126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-33b76c5b-7e3e-4cff-b01c-509fddc35ad5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.188852 Jan 27 16:07:24.279826 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 409/822] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:24 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:25.305139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:25.306313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:25.314349 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:25.314834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:25.315758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:25.316224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:25.486874 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:25.496155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:25.497799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:25.499357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e98ff299-13b6-4583-958d-44a17b38ab5a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.204660 Jan 27 16:07:25.499919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 414/823] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:25 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:26.521517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:26.522177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:26.528859 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:26.529312 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:26.530107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:26.530751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:26.712853 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:26.721657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:26.723241 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:26.724403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-aab065db-00c2-479f-a4b8-34e343631073 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.207150 Jan 27 16:07:26.724945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 410/824] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:26 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:27.744995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:27.745638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:27.753260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:27.753722 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:27.754663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:27.755195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:27.903959 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:27.911695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:27.913258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:27.914380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-df6e8e5f-44da-4f28-9b0f-cb49d3e17123 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.174049 Jan 27 16:07:27.914938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 415/825] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:27 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:28.563724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1520431552", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:28.623582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] validate_networks() for None {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:07:28.932989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:28.933737 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:28.934462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:07:28.934914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:07:28.935732 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:07:28.936154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:07:28.936736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:07:28.944438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:28.945146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:28.946092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:28.946676 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:28.946817 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:28.947384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:28.948211 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:28.948696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:28.966277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Getting quotas for project bb6d0e946f3f44bd93c8b084b3f9cf04. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:07:28.970070 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Getting quotas for user 71d4f16b0772462ea7463ec28529131d and project bb6d0e946f3f44bd93c8b084b3f9cf04. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:07:28.981163 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:07:28.983732 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:07:29.041516 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3622bdfb-0f36-4b17-8610-2c903fb22e58 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482264 Jan 27 16:07:29.043533 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 411/826] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:07:29.061062 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9f6109d7-bd61-45c4-b012-1bb017791a64 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:29.061673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9f6109d7-bd61-45c4-b012-1bb017791a64 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:29.168017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9f6109d7-bd61-45c4-b012-1bb017791a64 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:29.169606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:29.178397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:29.180071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:29.181069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dd1b54df-b28a-401e-909a-8d564415e526 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.252324 Jan 27 16:07:29.181607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 416/827] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:28 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:29.186716 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9f6109d7-bd61-45c4-b012-1bb017791a64 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1215 microversion: 2.1 time: 0.133906 Jan 27 16:07:29.187320 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 412/828] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:29 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:30.208426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:30.209772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:30.210294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:30.210910 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:30.221617 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:30.222357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:30.223870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:30.224312 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:30.235862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:30.236725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:30.239333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:30.239858 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:30.359664 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:30.369636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-982f059e-5329-4423-be57-29bb989d1edb tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1275 microversion: 2.1 time: 0.163079 Jan 27 16:07:30.370673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 413/829] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:30 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:07:30.415504 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cc724b81-2718-45eb-a587-58dea3550d64 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:30.421906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cc724b81-2718-45eb-a587-58dea3550d64 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:30.422357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cc724b81-2718-45eb-a587-58dea3550d64 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:30.453888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:30.462439 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:30.464856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:30.466036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6d4f6902-4520-4be1-8222-be3e2b2c1803 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.262026 Jan 27 16:07:30.475407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 417/830] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:30 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:30.514710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cc724b81-2718-45eb-a587-58dea3550d64 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Going to try to stop instance {{(pid=116260) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 27 16:07:30.560564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cc724b81-2718-45eb-a587-58dea3550d64 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 202 len: 0 microversion: 2.1 time: 0.149748 Jan 27 16:07:30.561547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 414/831] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:30 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:07:30.568945 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:30.569583 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:30.576359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:30.576920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:30.578032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:30.578546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:30.731754 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:30.740613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0f178658-6b27-47b3-b2d0-195db23fc01e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.174757 Jan 27 16:07:30.742422 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 418/832] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:30 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:31.388364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:31.389147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:31.395660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:31.396179 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:31.397023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:31.397546 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:31.485130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:31.485744 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:31.493122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:31.493616 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:31.494441 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:31.494872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:31.603775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:31.617271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8504c4b0-d73d-4868-8c2d-efab552a97d8 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.232504 Jan 27 16:07:31.617953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 415/833] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:31 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:31.646485 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:31.655920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:31.657414 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:31.658566 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-64913fd2-06be-4ce2-95c8-8e7016487845 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.177222 Jan 27 16:07:31.659151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 419/834] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:31 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:31.759101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:31.759976 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:31.766018 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:31.766473 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:31.767317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:31.767760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:31.915844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-1d566808-1159-4d4b-99dd-bcd8aed9a568 req-6855a738-2ebb-45e7-b646-e685f0c1d8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81da81ee-640d-4c5c-b554-8a4822be0f2a", "tag": "29abc74c-04d1-40cc-8f1b-4b80ec12426a"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:31.917599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:07:31.917599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:07:31.925008 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-1d566808-1159-4d4b-99dd-bcd8aed9a568 req-6855a738-2ebb-45e7-b646-e685f0c1d8e9 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:31.925459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-1d566808-1159-4d4b-99dd-bcd8aed9a568 req-6855a738-2ebb-45e7-b646-e685f0c1d8e9 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:31.936687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-1d566808-1159-4d4b-99dd-bcd8aed9a568 req-6855a738-2ebb-45e7-b646-e685f0c1d8e9 service nova] Creating event network-changed:29abc74c-04d1-40cc-8f1b-4b80ec12426a for instance 81da81ee-640d-4c5c-b554-8a4822be0f2a on hv-cinder-82635 Jan 27 16:07:31.942289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-1d566808-1159-4d4b-99dd-bcd8aed9a568 req-6855a738-2ebb-45e7-b646-e685f0c1d8e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030493 Jan 27 16:07:31.942883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 420/835] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:07:31.999083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:32.007933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-46435da4-20ec-4b39-b4d0-990ba37fb25c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.251884 Jan 27 16:07:32.008512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 416/836] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:31 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:32.634971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:32.635694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:32.641806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:32.642260 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:32.643063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:32.643503 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:32.677287 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:32.677891 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:32.684340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:32.684795 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:32.685582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:32.686020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:32.776650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:32.784098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d70bca11-ad4b-4c9d-9935-12b33f8b1740 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.153474 Jan 27 16:07:32.784671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 421/837] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:32 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:32.820409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:32.828198 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:32.829713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:32.831026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8e8b8d23-67a9-4deb-a64c-079515a2ab76 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.157345 Jan 27 16:07:32.831615 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 417/838] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:32 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:33.029704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:33.030215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:33.036192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:33.036636 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:33.037404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:33.037828 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:33.165532 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:33.173268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6641d662-0194-47bc-b48f-340344ab8216 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.147272 Jan 27 16:07:33.173829 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 422/839] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:33 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:33.800081 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:33.800686 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:33.807602 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:33.808045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:33.808814 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:33.809245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:33.849544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:33.850181 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:33.857219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:33.857674 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:33.858464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:33.858900 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:33.938754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:33.946092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-be1aa152-17d6-4c83-b3b4-3f651cc6f8f9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.149599 Jan 27 16:07:33.946659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 418/840] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:33 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:33.995356 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:34.005097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:34.006696 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:34.007897 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fd19c95f-cb4f-4a1d-a8e4-f56909cbe6c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.162059 Jan 27 16:07:34.008755 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 423/841] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:33 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:34.190409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:34.191038 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:34.196933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:34.197388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:34.198169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:34.198612 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:34.335620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:34.347009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-aa09e4a4-83c5-44b5-ba1f-33545f7d2a7c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.160125 Jan 27 16:07:34.347602 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 419/842] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:34 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:34.962275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:34.962887 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:34.969384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:34.969836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:34.970668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:34.971158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:35.027880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:35.028452 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:35.035117 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:35.035577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:35.036365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:35.036802 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:35.102120 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:35.109623 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2cfe84c8-d49b-4a2f-bb1f-332bbdbd8525 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.151626 Jan 27 16:07:35.110198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 424/843] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:34 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:07:35.167781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:35.175758 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:35.177253 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:35.178389 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b10a61a0-5dc8-4125-af6d-29df01035888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.154242 Jan 27 16:07:35.178985 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 420/844] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:35 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:35.364888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:35.365489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:35.371970 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:35.372401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:35.373172 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:35.373599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:35.502287 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:35.511905 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-46c9258e-1cfa-4bdb-86bd-6a8c7cf6bdb9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.149765 Jan 27 16:07:35.520412 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 425/845] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:35 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:36.129489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:36.130093 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:36.136780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:36.137235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:36.138029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:36.138466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:36.195962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:36.196560 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:36.203051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:36.203508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:36.204288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:36.204716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:36.283093 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:36.291606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7fe13486-e047-485f-bcd8-cd34e9bb3ab7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.165506 Jan 27 16:07:36.292013 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 421/846] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:36 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:36.343903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:36.352667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:36.354376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:36.356508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-aec80d5d-e077-47e3-a3b2-01733c5ce2cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.164174 Jan 27 16:07:36.357542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 426/847] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:36 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:36.536161 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:36.536678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:36.542655 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:36.543143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:36.543930 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:36.544394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:36.676335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:36.684017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5f2518a9-13cb-42aa-9731-b70c0e564e50 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.151639 Jan 27 16:07:36.684570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 422/848] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:36 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:37.307389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:37.307916 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:37.314505 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:37.314960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:37.315826 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:37.316263 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:37.377754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:37.379031 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:37.386007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:37.386466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:37.387298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:37.387736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:37.458593 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:37.466947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5a581290-d26e-4667-8687-bee3c9cf5990 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.163217 Jan 27 16:07:37.467550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 427/849] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:37 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:37.606471 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:37.615513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:37.617635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:37.618854 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-30004658-ea1f-49fc-b281-05d52c86e42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.244982 Jan 27 16:07:37.619659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 423/850] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:37 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:37.701015 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:37.701630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:37.708093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:37.708535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:37.709338 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:37.709771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:37.842256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:37.850293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c8aa8f10-ff74-4296-b195-bb35544c587e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.153009 Jan 27 16:07:37.850863 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 428/851] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:37 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:38.483335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:38.483863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:38.490339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:38.490796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:38.491936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:38.492372 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:38.635554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:38.637985 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:38.638597 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:38.643405 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-af112a50-da9f-4dea-b555-6b016abb1bf7 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.163521 Jan 27 16:07:38.644011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 424/852] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:38 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:38.645784 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:38.647820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:38.648882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:38.649313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:38.786319 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:38.794103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:38.795638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:38.796780 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6e27e69e-15b7-4366-a0d2-320da4e7076e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.163131 Jan 27 16:07:38.797338 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 429/853] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:38 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:38.868024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:38.868620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:38.874460 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:38.874908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:38.875713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:38.876142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:39.009358 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:39.017245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dbf49036-04bc-481c-a087-f485aad3634e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.153097 Jan 27 16:07:39.017809 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 425/854] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:38 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:39.663071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:39.664016 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:39.671664 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:39.672207 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:39.673179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:39.673655 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:39.811103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:39.815126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:39.815737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:39.818518 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-07098714-cd23-4efd-8bed-256468d1201f tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.160120 Jan 27 16:07:39.819631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 430/855] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:39 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:39.822534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:39.823011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:39.823808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:39.824250 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:39.955301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:39.963081 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:39.964883 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:39.966041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a174e51e-28b6-47e5-83d8-8469fc30341e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.154529 Jan 27 16:07:39.966596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 426/856] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:39 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:40.034911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:40.035551 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:40.041448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:40.041899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:40.042672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:40.043135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:40.169392 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:40.177045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8a4e8001-a84f-441b-9306-e6a66a816dcc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.145828 Jan 27 16:07:40.177605 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 431/857] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:40 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:40.836877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:40.837731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:40.844339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:40.844787 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:40.845591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:40.846028 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:40.985986 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:40.987697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:40.993381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:41.003101 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:41.003404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:41.003924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4bf7c554-dba5-4746-9acb-cc18921d412d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.171729 Jan 27 16:07:41.004247 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:41.004513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 427/858] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:40 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:41.004666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:41.194443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:41.195244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:41.201286 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:41.201738 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:41.202529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:41.205512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:41.213893 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:41.214801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:41.219954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:41.221420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b084aba0-f3d0-4804-8735-4d9eea1135dd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.240968 Jan 27 16:07:41.229157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 432/859] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:40 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:41.656021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:41.665145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-27aefeb8-a39d-4a5a-b696-1ca6a27c3193 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.474731 Jan 27 16:07:41.666096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 428/860] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:41 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:42.020651 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:42.021261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:42.028177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:42.028629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:42.029420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:42.029860 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:42.197146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:42.204391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-17591c97-af51-4bed-b649-ba6bb7ce2a1d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.187409 Jan 27 16:07:42.204960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 433/861] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:42 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:42.241965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:42.242568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:42.252525 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:42.253223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:42.254304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:42.255103 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:42.393001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:42.400786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:42.402548 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:42.403745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-41dae37e-6d43-456b-9230-5400ef43b23e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.166006 Jan 27 16:07:42.404306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 429/862] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:42 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:42.668427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-e972fc99-e434-4eb0-9965-bec2ec9d231e req-1767b478-c3c8-4d19-a588-099e6eb4e730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb168b3-a714-4f0b-aca9-d23922390178", "name": "network-vif-plugged", "status": "completed", "tag": "7f3911ec-edec-4658-b029-6a522d1a3093"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:42.670072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:07:42.670072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:07:42.679157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-e972fc99-e434-4eb0-9965-bec2ec9d231e req-1767b478-c3c8-4d19-a588-099e6eb4e730 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:42.679467 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-e972fc99-e434-4eb0-9965-bec2ec9d231e req-1767b478-c3c8-4d19-a588-099e6eb4e730 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:42.684259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:42.685384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:42.694653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:42.695550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:42.695703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-e972fc99-e434-4eb0-9965-bec2ec9d231e req-1767b478-c3c8-4d19-a588-099e6eb4e730 service nova] Creating event network-vif-plugged:7f3911ec-edec-4658-b029-6a522d1a3093 for instance ffb168b3-a714-4f0b-aca9-d23922390178 on hv-cinder-82635 Jan 27 16:07:42.697084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:42.697680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:42.701603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-e972fc99-e434-4eb0-9965-bec2ec9d231e req-1767b478-c3c8-4d19-a588-099e6eb4e730 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037540 Jan 27 16:07:42.702629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 434/863] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:07:42.836838 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:42.847029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fa3df2d5-9f11-4b08-8a36-9a5dcbe2173a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.167674 Jan 27 16:07:42.847754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 430/864] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:42 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:07:43.221099 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:43.221792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:43.229134 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:43.229586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:43.230359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:43.230789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:43.368947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:43.376922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c5f84225-b62b-4cc2-8357-ac1419e45347 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.159652 Jan 27 16:07:43.377610 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 435/865] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:43 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:43.425899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:43.426635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:43.433119 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:43.433565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:43.434352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:43.434784 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:43.566261 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:43.575099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:43.576592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:43.577733 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-534fabaa-696d-4f2b-86f2-d3b174b2fea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.160084 Jan 27 16:07:43.578285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 431/866] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:43 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:43.874296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:43.874911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:43.880937 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:43.881908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:43.882690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:43.883276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:44.018474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:44.026655 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7fd3d536-2b65-4356-8b06-eb9f31d55d20 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.157696 Jan 27 16:07:44.027191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 436/867] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:43 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:44.394147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:44.394666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:44.401348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:44.401803 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:44.402583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:44.403076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:44.540512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:44.548090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2fef0ca8-69b7-465c-abb9-a6081dc10c10 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.157622 Jan 27 16:07:44.548692 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 432/868] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:44 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:44.596528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:44.599540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:44.606650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:44.607140 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:44.607942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:44.608381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:44.719589 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-6a6c441c-862a-4293-8fc2-1b56aaa7ae62 req-f293fa3f-7e9c-4f65-a3ec-52abc44f931d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81da81ee-640d-4c5c-b554-8a4822be0f2a", "name": "network-vif-plugged", "status": "completed", "tag": "29abc74c-04d1-40cc-8f1b-4b80ec12426a"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:44.722304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:07:44.722304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:07:44.731350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-6a6c441c-862a-4293-8fc2-1b56aaa7ae62 req-f293fa3f-7e9c-4f65-a3ec-52abc44f931d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:44.731944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-6a6c441c-862a-4293-8fc2-1b56aaa7ae62 req-f293fa3f-7e9c-4f65-a3ec-52abc44f931d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:44.746742 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-6a6c441c-862a-4293-8fc2-1b56aaa7ae62 req-f293fa3f-7e9c-4f65-a3ec-52abc44f931d service nova] Creating event network-vif-plugged:29abc74c-04d1-40cc-8f1b-4b80ec12426a for instance 81da81ee-640d-4c5c-b554-8a4822be0f2a on hv-cinder-82635 Jan 27 16:07:44.752517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-6a6c441c-862a-4293-8fc2-1b56aaa7ae62 req-f293fa3f-7e9c-4f65-a3ec-52abc44f931d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037125 Jan 27 16:07:44.752704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:44.753652 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 433/869] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:07:44.761501 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:44.763119 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:44.764288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6f39a682-bc92-4e93-9b1f-04b437126da7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.171626 Jan 27 16:07:44.764842 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 437/870] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:44 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:45.045076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:45.045844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:45.052455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:45.053578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:45.054384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:45.054827 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:45.182920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:45.190634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-54543ebf-e8c6-4cb9-98f2-f1c882cce1eb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.149879 Jan 27 16:07:45.191304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 434/871] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:45 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:45.564993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:45.565598 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:45.573962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:45.574414 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:45.575350 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:45.575790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:45.706288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:45.714736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-608f85ba-c0f4-4808-b7c4-2897d23b72c9 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.153586 Jan 27 16:07:45.715353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 438/872] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:45 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:45.782507 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:45.783129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:45.789474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:45.789922 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:45.790704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:45.791167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:45.926849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:45.934708 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:45.936257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:45.937387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bb2f2bd1-f7c3-45b7-beb5-6810a903846d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.158574 Jan 27 16:07:45.937943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 435/873] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:45 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:46.208136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:46.208700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:46.215129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:46.215584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:46.216370 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:46.216805 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:46.352499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:46.360465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6dad9134-5eaf-4cc2-bf0c-485355dba5c9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.156271 Jan 27 16:07:46.361023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 439/874] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:46 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:07:46.731531 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:46.732132 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:46.738220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:46.738660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:46.739474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:46.739904 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:46.871202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:46.878394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-378fb7ba-4e13-491e-bfbd-07bd7d22318d tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1315 microversion: 2.1 time: 0.150523 Jan 27 16:07:46.878955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 436/875] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:46 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:07:46.955707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:46.956308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:46.963730 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:46.964205 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:46.965021 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:46.965459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:47.292187 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:47.299870 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:47.301371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:47.302512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dbf1f94e-781d-47c2-a901-2cddace4c1c8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1743 microversion: 2.20 time: 0.350449 Jan 27 16:07:47.303080 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 440/876] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:46 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1743 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:47.377300 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:47.377908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:47.384485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:47.384935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:47.385719 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:47.386157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:47.516799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:47.524864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b1d4ac73-dee2-4377-932c-367c82c9bbc6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.151192 Jan 27 16:07:47.525428 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 437/877] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:47 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:47.894118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:47.894723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:47.900885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:47.901330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:47.902110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:47.902538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.029985 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:48.037972 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-59d56e5f-9e9d-43ce-8029-7f5e36f0f199 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1465 microversion: 2.1 time: 0.147498 Jan 27 16:07:48.038530 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 441/878] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:47 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1465 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:48.074791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:48.075308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:48.081637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.082086 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.082862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.083325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.110348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:07:48.193699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-411bfdc6-5e2e-465c-b688-d34409a6c0b2 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "DELETE /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 204 len: 0 microversion: 2.1 time: 0.122045 Jan 27 16:07:48.194475 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 438/879] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:07:48 2022] DELETE /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:07:48.203139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:48.203671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:48.210404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.210848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.211945 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.212510 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.322288 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:48.324071 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:48.330044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.330672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.331474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.331991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.368888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:48.376256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d5a2d91e-bc24-4b05-9f11-55cf986c86b6 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1471 microversion: 2.1 time: 0.177282 Jan 27 16:07:48.377041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 442/880] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:48 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:48.541669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:48.542720 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:48.543195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:48.549420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.550135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.550939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:48.551401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:48.552223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:48.553870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:48.555162 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-134edcf9-4aa5-4f8f-ae17-5049f9ad4ed9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.238000 Jan 27 16:07:48.556099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 439/881] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:48 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:48.717929 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:48.728353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-99387884-1c35-4dab-a71d-8789eee29251 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.190280 Jan 27 16:07:48.729074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 443/882] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:48 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:49.393140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:49.393889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:49.401382 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:49.401894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:49.402697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:49.403180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:49.546969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:49.555395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b2ffc991-5acc-4f3a-b013-c37c05462e0e tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1471 microversion: 2.1 time: 0.165898 Jan 27 16:07:49.556329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 440/883] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:49 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:49.574579 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:49.576014 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:49.582446 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:49.583174 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:49.584700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:49.585315 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:49.749763 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:49.750745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:49.760191 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:49.760995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:49.762009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:49.762803 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:49.953923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:49.962894 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:49.965706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8e0a22bc-9dc2-4fc5-a7c5-1b6d695b1aed tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.223248 Jan 27 16:07:49.967457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 441/884] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:49 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:49.982854 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:49.984585 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:49.985891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-14ffac00-2c06-4606-9c5b-cfbe5ab897b4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.415567 Jan 27 16:07:49.986502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 444/885] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:49 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:07:50.577605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:50.578209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:50.585190 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:50.585824 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:50.587243 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:50.588518 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:50.832111 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d4f16b0772462ea7463ec28529131d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6d0e946f3f44bd93c8b084b3f9cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:50.841495 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5c722a73-fca4-49a9-bc8c-93724ad59afc tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 200 len: 1471 microversion: 2.1 time: 0.268095 Jan 27 16:07:50.857395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 442/886] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:50 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:50.974366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-ad56e290-2d9f-4d4e-b7d4-cd1b109690a7 req-ccb11366-2f7f-4f7d-aaf1-9768f220c78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81da81ee-640d-4c5c-b554-8a4822be0f2a", "name": "network-vif-deleted", "tag": "29abc74c-04d1-40cc-8f1b-4b80ec12426a"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:50.978922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:07:50.978922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:07:50.983729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:50.984574 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:50.996189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.002674 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.004989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.006362 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.008586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-ad56e290-2d9f-4d4e-b7d4-cd1b109690a7 req-ccb11366-2f7f-4f7d-aaf1-9768f220c78e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.009035 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-ad56e290-2d9f-4d4e-b7d4-cd1b109690a7 req-ccb11366-2f7f-4f7d-aaf1-9768f220c78e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.050141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-ad56e290-2d9f-4d4e-b7d4-cd1b109690a7 req-ccb11366-2f7f-4f7d-aaf1-9768f220c78e service nova] Creating event network-vif-deleted:29abc74c-04d1-40cc-8f1b-4b80ec12426a for instance 81da81ee-640d-4c5c-b554-8a4822be0f2a on hv-cinder-82635 Jan 27 16:07:51.056435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-ad56e290-2d9f-4d4e-b7d4-cd1b109690a7 req-ccb11366-2f7f-4f7d-aaf1-9768f220c78e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092928 Jan 27 16:07:51.057455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 445/887] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:07:51.069780 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:51.087177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:51.110891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.123835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.125008 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.125674 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.256176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:51.266293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7c97a0bf-fa35-4c7f-94cc-9bbb2ecd0175 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1723 microversion: 2.1 time: 0.286351 Jan 27 16:07:51.267884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 443/888] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:50 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:51.399740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cb550439-1475-4e5e-bb7f-06da3bd0aeaf tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93fec5c1-c636-48c1-902d-ee16e908a5c0", "device": "/dev/sdb"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:51.402880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cb550439-1475-4e5e-bb7f-06da3bd0aeaf tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:51.420773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb550439-1475-4e5e-bb7f-06da3bd0aeaf tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.420773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb550439-1475-4e5e-bb7f-06da3bd0aeaf tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.422453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb550439-1475-4e5e-bb7f-06da3bd0aeaf tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.423114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cb550439-1475-4e5e-bb7f-06da3bd0aeaf tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.490913 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:51.508532 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:51.517508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:51.518790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-58020977-edfd-4609-9b60-9063f848e7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.455542 Jan 27 16:07:51.519468 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 446/889] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:51 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:51.783156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cb550439-1475-4e5e-bb7f-06da3bd0aeaf tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "POST /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391521 Jan 27 16:07:51.786577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 444/890] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:07:51 2022] POST /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:07:51.857738 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:51.858288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] [instance: 81da81ee-640d-4c5c-b554-8a4822be0f2a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:51.879130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.879130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.879130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:51.879130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:51.895366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] HTTP exception thrown: Instance 81da81ee-640d-4c5c-b554-8a4822be0f2a could not be found. Jan 27 16:07:51.896768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] Returning 404 to user: Instance 81da81ee-640d-4c5c-b554-8a4822be0f2a could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:07:51.898160 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-892e1f5b-baae-4ab6-92c6-9d3dee12cd48 tempest-VolumesNegativeTest-447855311 tempest-VolumesNegativeTest-447855311-project] 10.222.0.61 "GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a" status: 404 len: 111 microversion: 2.1 time: 0.043707 Jan 27 16:07:51.906730 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 447/891] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:51 2022] GET /compute/v2.1/servers/81da81ee-640d-4c5c-b554-8a4822be0f2a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:07:52.288858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:52.290908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:52.305870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:52.306959 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:52.307863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:52.308557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:52.493786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:52.503915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1edb809f-8dba-475c-915f-abaa9a00c086 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1700 microversion: 2.1 time: 0.220591 Jan 27 16:07:52.507032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 445/892] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:52 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1700 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:52.521685 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2a45103e-9397-4b4a-9fc1-0758c1ba090a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:07:52.531590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a45103e-9397-4b4a-9fc1-0758c1ba090a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:52.539370 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a45103e-9397-4b4a-9fc1-0758c1ba090a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:52.541047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:52.543721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:52.562161 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:52.562874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:52.563742 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:52.564177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:52.663522 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2a45103e-9397-4b4a-9fc1-0758c1ba090a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Going to try to start instance {{(pid=116261) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 27 16:07:52.730304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2a45103e-9397-4b4a-9fc1-0758c1ba090a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 202 len: 0 microversion: 2.1 time: 0.212837 Jan 27 16:07:52.735854 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 448/893] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:07:52 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:07:52.742085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:52.742865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:52.744031 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:52.753373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:52.754157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:52.755675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:52.756499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:52.756908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:52.759430 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:52.761404 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-aabf87f3-990a-49a7-b63a-aa122f29a362 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.226881 Jan 27 16:07:52.781398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 446/894] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:52 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:52.943528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:52.960042 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e6b5854e-028a-42ba-b442-8fe59efdbec5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1709 microversion: 2.1 time: 0.221950 Jan 27 16:07:52.961763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 449/895] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:52 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:53.785667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:53.786908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:53.795333 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:53.795915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:53.797214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:53.797880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:53.962355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:53.977088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:53.978695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:53.979671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:53.980206 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-01cc011d-5f89-497b-ab18-927b26419ec8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.200731 Jan 27 16:07:53.980825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 447/896] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:53 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:53.981311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:53.988923 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:53.992643 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:53.994727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:53.997075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:54.171600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:54.180223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cd1f0d5c-91c6-4d43-9084-3638a26f42ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1709 microversion: 2.1 time: 0.204473 Jan 27 16:07:54.181281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 450/897] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:53 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1709 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:54.999633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:55.000351 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:55.029488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:55.030129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:55.039695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:55.040256 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:55.201586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:55.202259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:55.213928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:55.216410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:55.218537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:55.221444 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:55.282491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:55.291554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:55.298347 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:55.299615 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f01ade14-7709-4a39-b748-7e3df35ad8ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.305793 Jan 27 16:07:55.303696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 448/898] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:54 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:55.424302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:55.433735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-80939a00-fc43-4333-aadb-395b985bbcea tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1713 microversion: 2.1 time: 0.238170 Jan 27 16:07:55.434059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 451/899] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:07:55 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1713 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:07:56.322005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:56.322672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:56.330089 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:56.330884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:56.331949 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:56.341692 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:56.534948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:56.544094 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:56.545907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:56.547527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ea8d77af-48b9-444b-b8c7-4e88efb9e60d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.230056 Jan 27 16:07:56.560028 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 449/900] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:56 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:57.575852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:57.575852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:57.575852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:57.575852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:57.576931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:57.576931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:57.797271 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:57.805813 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:57.807367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:57.808513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2db4a6e4-5701-4d29-9334-e8a35fafa750 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.245262 Jan 27 16:07:57.809102 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 452/901] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:57 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:07:58.826829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:07:58.827570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:07:58.835043 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:58.835785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:58.836711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:07:58.837213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:07:58.989765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:58.998212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:58.999866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:07:59.001017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-20891f3e-884f-4407-a2dc-deba80cd3695 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.177960 Jan 27 16:07:59.002123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 450/902] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:07:58 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:00.019824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:00.021429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:00.028410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:00.029341 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:00.030163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:00.030590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:00.214856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:00.225039 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:00.226864 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:00.228322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f6c3ba1a-453a-4055-926f-065fa2426ce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.212517 Jan 27 16:08:00.229059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 453/903] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:00 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:01.428509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:01.430555 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:01.438276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:01.438750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:01.439966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:01.441128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:01.611145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:01.619859 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:01.621366 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:01.622524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8cf50e2f-ceac-43b0-9166-cc3a0d43bf6d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.378404 Jan 27 16:08:01.623115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 451/904] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:01 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:02.641327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:02.642126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:02.649293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:02.649835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:02.650909 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:02.651439 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:02.795989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:02.804926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:02.815372 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:02.815372 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-20fc7d0a-59f7-4a6d-a82e-603098ab332d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.172881 Jan 27 16:08:02.821798 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 454/905] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:02 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:03.828809 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:03.829381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:03.836857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:03.837311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:03.838100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:03.838537 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:03.971364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:03.979138 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:03.981381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:03.981760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dfbc3744-9914-4032-99d3-79d559c87694 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.156591 Jan 27 16:08:03.982312 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 452/906] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:03 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:05.001228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:05.001869 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:05.008732 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:05.009186 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:05.009971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:05.010405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:05.136137 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:05.143837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:05.145927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:05.147116 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ea61746f-8db7-44ac-89d0-c8e114949ded tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.149525 Jan 27 16:08:05.147665 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 455/907] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:04 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:06.165706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:06.166313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:06.172665 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:06.173117 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:06.173927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:06.174361 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:06.298457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:06.306112 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:06.307657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:06.308799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-21a8c387-9f9a-4180-be0b-0ceb12bcaaa8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.146868 Jan 27 16:08:06.309360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 453/908] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:06 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:07.326902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:07.327570 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:07.334563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:07.335042 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:07.335834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:07.336273 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:07.465520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:07.473395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:07.474894 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:07.476068 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3a6eb185-66a7-4b09-a714-39c112a8b5a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.152846 Jan 27 16:08:07.476631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 456/909] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:07 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:08.493692 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:08.494293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:08.500502 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:08.500944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:08.501706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:08.502137 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:08.630114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:08.637651 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:08.639176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:08.640315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b87d62a7-ecc9-4a7d-8ef2-e313ee5589c2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1738 microversion: 2.20 time: 0.150613 Jan 27 16:08:08.640862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 454/910] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:08 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:09.659026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:09.659632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:09.666457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:09.666910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:09.667723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:09.668163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:09.796790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:09.804846 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:09.806352 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:09.807513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-02cb6ee7-1a34-4ff2-96dd-96af67a77c8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.152198 Jan 27 16:08:09.808057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 457/911] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:09 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:10.824758 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:10.825350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:10.831601 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:10.831973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:10.832830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:10.833193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:10.964380 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:10.971960 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:10.973461 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:10.974596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0bc54dc0-8e1f-4454-bb29-83000f0f0ce9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.153516 Jan 27 16:08:10.975186 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 455/912] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:10 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:11.992811 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:11.993390 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:11.999681 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:12.000127 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:12.000895 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:12.001326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:12.128776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:12.137314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:12.138817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:12.139989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b34cbb9e-1c1f-4646-bf9a-24e364f5695b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.151118 Jan 27 16:08:12.140539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 458/913] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:11 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:13.157860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:13.158470 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:13.165383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:13.165838 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:13.166618 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:13.167084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:13.296927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:13.304640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:13.306088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:13.307257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-90e8dc81-aa3a-4a17-9e11-7b466dc9da5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.153061 Jan 27 16:08:13.307819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 456/914] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:13 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:14.032114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-7144543a-d473-45cc-9f15-9f5438c83c18 req-b4289e80-e2e1-438c-9c0b-0ba522b0795e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb168b3-a714-4f0b-aca9-d23922390178", "name": "network-vif-unplugged", "status": "completed", "tag": "7f3911ec-edec-4658-b029-6a522d1a3093"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:08:14.033671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:08:14.033671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:08:14.042258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-7144543a-d473-45cc-9f15-9f5438c83c18 req-b4289e80-e2e1-438c-9c0b-0ba522b0795e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:14.042736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-7144543a-d473-45cc-9f15-9f5438c83c18 req-b4289e80-e2e1-438c-9c0b-0ba522b0795e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:14.055353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-7144543a-d473-45cc-9f15-9f5438c83c18 req-b4289e80-e2e1-438c-9c0b-0ba522b0795e service nova] Creating event network-vif-unplugged:7f3911ec-edec-4658-b029-6a522d1a3093 for instance ffb168b3-a714-4f0b-aca9-d23922390178 on hv-cinder-82635 Jan 27 16:08:14.060262 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-7144543a-d473-45cc-9f15-9f5438c83c18 req-b4289e80-e2e1-438c-9c0b-0ba522b0795e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031778 Jan 27 16:08:14.060846 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 459/915] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:08:14.325703 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:14.326327 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:14.332588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:14.333036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:14.333812 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:14.334246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:14.466879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:14.475120 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:14.476621 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:14.477749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0c738a29-808c-4f88-b7c5-04fe02e6b4d4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.155710 Jan 27 16:08:14.478301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 457/916] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:14 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:15.496431 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:15.497118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:15.504380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:15.504829 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:15.505615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:15.506051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:15.637496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:15.645222 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:15.646725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:15.647903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7db7eaa5-1024-401b-a3ec-8d0946614096 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.155567 Jan 27 16:08:15.648455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 460/917] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:15 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:08:16.665940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:16.666573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:16.672851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:16.673306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:16.674085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:16.674533 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:16.799949 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:16.808895 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:16.810543 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:16.811728 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-91ab09e2-a71d-462e-b393-ddf5b3165dc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.149493 Jan 27 16:08:16.812285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 458/918] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:16 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:17.830353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:17.830952 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:17.838959 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:17.839438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:17.840214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:17.840639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:17.970611 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:17.978499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:17.980013 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:17.981246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5220977f-fc3a-4972-bbef-06daebaadf18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.154604 Jan 27 16:08:17.981798 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 461/919] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:17 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:18.999554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:19.000155 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:19.006414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:19.006864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:19.007682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:19.008114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:19.140238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:19.148655 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:19.150147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:19.151317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-48081d61-3f1f-4195-8e53-889889d6c06f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.155409 Jan 27 16:08:19.151875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 459/920] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:18 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:20.170107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:20.170743 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:20.177187 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:20.177673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:20.178450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:20.178883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:20.307359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:20.314995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:20.317012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:20.318135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ff80cd49-6eb0-4b9d-b076-4f54d1f7c3cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1720 microversion: 2.20 time: 0.151802 Jan 27 16:08:20.318687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 462/921] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:20 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:21.338025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:21.338879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:21.345820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:21.346265 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:21.347139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:21.348261 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:21.480701 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:21.488401 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:21.490169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:21.491346 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-971dc338-16a1-4ab9-9be0-f5c84ae1505e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1723 microversion: 2.20 time: 0.157710 Jan 27 16:08:21.491905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 460/922] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:21 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:21.509009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d63cc620-557e-4449-a190-2109ae9d4b18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88205848-6f37-4d34-8312-0f8dde787fb4"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:08:21.510089 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d63cc620-557e-4449-a190-2109ae9d4b18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:21.516309 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d63cc620-557e-4449-a190-2109ae9d4b18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:21.516756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d63cc620-557e-4449-a190-2109ae9d4b18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:21.517528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d63cc620-557e-4449-a190-2109ae9d4b18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:21.517964 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d63cc620-557e-4449-a190-2109ae9d4b18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:21.809011 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d63cc620-557e-4449-a190-2109ae9d4b18 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303621 Jan 27 16:08:21.809598 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 463/923] 10.222.0.61 () {62 vars in 1363 bytes} [Thu Jan 27 16:08:21 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:08:21.916454 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-246cedc3-e695-4891-91b0-dc46b707ea6a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:08:21.917016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-246cedc3-e695-4891-91b0-dc46b707ea6a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:21.922783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-246cedc3-e695-4891-91b0-dc46b707ea6a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:21.923276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-246cedc3-e695-4891-91b0-dc46b707ea6a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:21.924046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-246cedc3-e695-4891-91b0-dc46b707ea6a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:21.924479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-246cedc3-e695-4891-91b0-dc46b707ea6a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:22.110335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-246cedc3-e695-4891-91b0-dc46b707ea6a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action" status: 202 len: 0 microversion: 2.20 time: 0.197546 Jan 27 16:08:22.110940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 461/924] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:08:21 2022] POST /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:08:22.120641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:22.120641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:22.133300 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:22.133746 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:22.134647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:22.135184 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:22.271316 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:22.280881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:22.283516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:22.285513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-004e04fa-b104-4874-9bd6-87486aeddb5c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1749 microversion: 2.20 time: 0.169583 Jan 27 16:08:22.286149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 464/925] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:22 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:23.303205 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:23.304008 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:23.310357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:23.310799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:23.311612 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:23.312042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:23.446696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:23.454682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:23.456246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:23.457374 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b55fc2ee-9b6c-4ea0-bf62-b5d31addccbe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1749 microversion: 2.20 time: 0.157914 Jan 27 16:08:23.457920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 462/926] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:23 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:24.475832 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:24.476436 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:24.483568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:24.484019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:24.484808 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:24.485278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:24.638101 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:24.647529 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:24.649024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:24.650170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b1379ca4-3c67-453e-b1f0-b799f1be5b86 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.178691 Jan 27 16:08:24.650720 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 465/927] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:24 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:25.669224 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:25.669828 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:25.676260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:25.676713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:25.677498 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:25.677936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:25.810567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:25.818927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:25.820583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:25.821789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-54f9a907-e006-4315-a78c-62908a4e79d1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.156179 Jan 27 16:08:25.822342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 463/928] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:25 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:26.850514 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:26.851211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:26.857539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:26.857991 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:26.858771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:26.859247 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:26.999442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:27.010182 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:27.012564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:27.013690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0176f778-a9ac-410f-9795-2890bc1dcc90 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.166907 Jan 27 16:08:27.014242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 466/929] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:26 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:28.033354 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:28.033914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:28.040370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:28.040823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:28.041620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:28.042032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:28.171894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:28.180978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:28.182471 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:28.183638 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0dd30546-ae97-4dab-a01f-45965547157f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.154120 Jan 27 16:08:28.184197 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 464/930] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:28 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:29.202486 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:29.203110 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:29.210057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:29.210501 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:29.211311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:29.211739 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:29.342493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:29.350878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:29.352507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:29.353654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-921b0573-d076-4ac2-9b01-26a6162812eb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.154899 Jan 27 16:08:29.354215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 467/931] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:29 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:30.372536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:30.373133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:30.380023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:30.380464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:30.381235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:30.381661 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:30.512958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:30.521025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:30.522694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:30.523858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3c99d9e2-7f71-4aeb-8661-d7d0fa3b34bb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.155009 Jan 27 16:08:30.524408 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 465/932] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:30 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:31.541495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:31.542097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:31.548524 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:31.548971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:31.550336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:31.550866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:31.682647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:31.691085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:31.692583 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:31.693729 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7cb70087-e2eb-4af6-9a76-bea795f84c56 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.155920 Jan 27 16:08:31.694283 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 468/933] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:31 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:32.712995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:32.713600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:32.719855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:32.720297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:32.721066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:32.721494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:32.848305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:32.856426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:32.857930 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:32.859101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7f5fd278-bc7f-4fa7-8d8e-e4911d5fead2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.150808 Jan 27 16:08:32.859653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 466/934] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:32 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:33.878640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:33.879271 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:33.885500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:33.885946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:33.886719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:33.887189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:34.016107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:34.024214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:34.025697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:34.026826 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8560af5e-80fa-4389-b428-602bf97f9e58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.152543 Jan 27 16:08:34.027415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 469/935] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:33 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:35.045275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:35.045886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:35.052386 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:35.052833 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:35.053605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:35.054034 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:35.181647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:35.189836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:35.191383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:35.192530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5d1f1ca2-f095-4b18-bed5-a56cbdfe1e5d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.150955 Jan 27 16:08:35.193071 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 467/936] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:35 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:36.210521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:36.211173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:36.217398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:36.217850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:36.218627 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:36.219097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:36.493220 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:36.501345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:36.503373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:36.504522 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-07370fbd-476f-44dc-acc2-f17f58409b62 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.297695 Jan 27 16:08:36.505070 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 470/937] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:36 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:37.521470 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:37.522068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:37.528472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:37.528924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:37.529706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:37.530145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:37.657851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:37.668517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:37.670709 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:37.672452 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4fc16b9b-6711-4383-8863-eb767f37b286 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1751 microversion: 2.20 time: 0.154720 Jan 27 16:08:37.673012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 468/938] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:37 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:08:38.692076 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:38.692800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:38.698725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:38.699385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:38.700164 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:38.700593 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:38.857998 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:38.868134 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:38.870459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:38.872179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-133bae3b-6ed9-43fa-be6b-fc82599ef2d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.184406 Jan 27 16:08:38.873242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 471/939] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:38 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:39.364063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:39.364638 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:39.371330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:39.371976 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:39.372899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:39.373406 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:39.530714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lazy-loading 'services' on Instance uuid 89638f5a-769c-4331-b562-58ebf191dc46 {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:08:39.660377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d73cecf2-b3ff-4936-b9cb-8fe99ff2b72e tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "DELETE /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46/os-volume_attachments/93fec5c1-c636-48c1-902d-ee16e908a5c0" status: 202 len: 0 microversion: 2.1 time: 0.300028 Jan 27 16:08:39.661166 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 469/940] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:08:39 2022] DELETE /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46/os-volume_attachments/93fec5c1-c636-48c1-902d-ee16e908a5c0 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:08:39.889515 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:39.890123 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:39.896739 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:39.897193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:39.897985 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:39.898565 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:40.047477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:40.056455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:40.058409 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:40.059623 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bb763742-4bd9-4b71-b471-bb979293c908 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.173718 Jan 27 16:08:40.060162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 472/941] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:39 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:41.078806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:41.079562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:41.086730 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:41.087299 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:41.088249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:41.088949 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:41.258002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:41.270545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:41.272642 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:41.274018 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dd80ee4a-bb4f-4f38-bcad-e1e430ebeec1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.200028 Jan 27 16:08:41.275147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 470/942] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:41 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:42.293772 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:42.294474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:42.301019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:42.301478 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:42.302263 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:42.302705 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:42.458872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:42.467874 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:42.469353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:42.470520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8ca72069-dc32-4043-831b-b944c3702471 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.181119 Jan 27 16:08:42.471769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 473/943] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:42 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:43.501416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:43.502773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:43.516930 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:43.518677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:43.521167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:43.523864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:43.761679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:43.772851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:43.776319 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:43.778697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9bdd97fc-6317-49ac-9ae1-5e62604c477b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.292700 Jan 27 16:08:43.780557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 471/944] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:43 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:44.812499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:44.813107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:44.825138 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:44.826609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:44.827670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:44.834934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:45.060553 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:45.077259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:45.078903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:45.080198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1d139514-fbe6-47e7-8140-5988758c63f5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.272982 Jan 27 16:08:45.081267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 474/945] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:44 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:46.106325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:46.108269 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:46.120384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:46.121152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:46.122200 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:46.123416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:46.597701 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:46.607741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:46.609554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:46.611548 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8f0c397d-a45e-442d-ae54-4781a59b9ea1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.509288 Jan 27 16:08:46.623505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 472/946] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:46 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:08:47.630010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:47.631334 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:47.639435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:47.640132 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:47.641135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:47.641736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:47.849406 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:47.868967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:47.871154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:47.873703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9bf87c4c-4c3f-4a2c-96c7-e15723cac979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.247308 Jan 27 16:08:47.874833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 475/947] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:47 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:48.899530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:48.900075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:48.913080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:48.916349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:48.917438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:48.918253 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:49.242663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:49.262237 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:49.264346 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:49.265919 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-566a8ad8-586e-4d1e-85d4-cdc31fc2fb0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.377390 Jan 27 16:08:49.267100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 473/948] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:48 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:50.286805 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:50.288280 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:50.301613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:50.304400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:50.305512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:50.311113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:50.755299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:50.772170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:50.801434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:50.817473 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-89708102-e52d-4a98-a9d9-8ecda143529e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.535621 Jan 27 16:08:50.837628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 476/949] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:50 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:08:51.870705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:51.871339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:51.907196 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:51.910224 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:51.911308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:51.914176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:52.198059 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:52.207588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:52.210413 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:52.211935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eb8e0dc2-6ea0-44c4-a104-6c3ca5a9b93f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.369257 Jan 27 16:08:52.213386 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 474/950] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:51 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:53.231645 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:53.232256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:53.242728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:53.243574 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:53.244612 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:53.245288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:53.547587 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:53.558968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:53.561562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:53.565899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-319114a0-8ffa-4b8f-afef-c379bcbad7d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.337392 Jan 27 16:08:53.569816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 477/951] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:53 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:54.444488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fd984427-a0b0-4d18-bed1-ed8fdabbdc45 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Action: 'create', calling method: .version_select at 0x7f78174fba60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1848046509"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:08:54.458635 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-fd984427-a0b0-4d18-bed1-ed8fdabbdc45 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Getting quotas for project 1c3096dd728a485190c1c92efa3850e3. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:08:54.462550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-fd984427-a0b0-4d18-bed1-ed8fdabbdc45 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Getting quotas for user a046e67fe14e47e6b1a0442abb7cb58f and project 1c3096dd728a485190c1c92efa3850e3. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:08:54.587361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:54.587972 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:54.594545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:54.595861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:54.597308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:54.597752 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:54.674375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-fd984427-a0b0-4d18-bed1-ed8fdabbdc45 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Getting quotas for project 1c3096dd728a485190c1c92efa3850e3. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:08:54.679137 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-fd984427-a0b0-4d18-bed1-ed8fdabbdc45 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Getting quotas for user a046e67fe14e47e6b1a0442abb7cb58f and project 1c3096dd728a485190c1c92efa3850e3. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:08:54.693717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fd984427-a0b0-4d18-bed1-ed8fdabbdc45 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.427636 Jan 27 16:08:54.694212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 475/952] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Jan 27 16:08:54 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:08:54.775812 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:54.794996 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:54.804615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:54.806045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-75d43d4f-614c-4ab6-86f3-4cdb6556df16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.223779 Jan 27 16:08:54.807111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 478/953] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:54 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:08:55.825941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:55.826608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:55.833455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:55.834021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:55.835084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:55.835630 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:56.081966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:56.092014 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:56.093749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:56.094938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2f955170-5bdf-4fac-841a-a4e247c5331a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.273290 Jan 27 16:08:56.095513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 476/954] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:55 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:57.114568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:57.115198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:57.121396 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:57.121848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:57.122617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:57.123107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:57.265417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:57.275214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:57.277232 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:57.278424 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4c6fa824-0fd2-4988-9189-67de5a2285f8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.168478 Jan 27 16:08:57.279003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 479/955] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:57 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:08:57.393009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:57.393730 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:57.400765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:57.401451 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:57.402423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:57.402851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:57.433542 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:08:57.541592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-21e8c6ce-d41b-4591-8670-58e87652bc58 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "DELETE /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 204 len: 0 microversion: 2.1 time: 0.153726 Jan 27 16:08:57.542189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 477/956] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:08:57 2022] DELETE /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:08:57.556092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:57.559992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:57.567193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:57.567573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:57.569021 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:57.569465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:57.715303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:57.725064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-551f5e9f-a270-464d-b59b-06d3de920dd1 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1513 microversion: 2.1 time: 0.177771 Jan 27 16:08:57.725635 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 480/957] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:08:57 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:08:58.298325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:58.299750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:58.306772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:58.307776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:58.309337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:58.310677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:58.496056 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:58.506168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:58.517662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:58.518923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-85e7352f-4811-4cb2-84b0-8debae63c9e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.225073 Jan 27 16:08:58.522427 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 478/958] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:58 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:08:58.743758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:58.744603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:58.751502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:58.751953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:58.752813 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:58.753254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:58.907118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:58.921761 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3b30048b-42d0-4ccb-81e9-28a2b66fde42 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1513 microversion: 2.1 time: 0.181893 Jan 27 16:08:58.922373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 481/959] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:08:58 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:08:59.541968 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:59.542615 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:59.549447 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:59.550052 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:59.550896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:59.551411 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:59.689492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:59.698609 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:59.700154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:08:59.701307 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-efdc078f-70f2-46be-8bfb-41caf6d9854f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.166553 Jan 27 16:08:59.701863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 479/960] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:08:59 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:08:59.940098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:08:59.940872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:08:59.947460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:59.947980 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:08:59.948833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:08:59.949333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:00.116231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:00.126480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-45e4abc3-d9cc-4571-9e14-46d39fd2a5e4 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 200 len: 1513 microversion: 2.1 time: 0.190449 Jan 27 16:09:00.127534 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 482/961] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:08:59 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:00.479786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-9da5cdb5-13a5-4ebb-92dd-6eb3f863b8f7 req-aa469fe0-c134-46ef-bca2-0b2eb27ec9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89638f5a-769c-4331-b562-58ebf191dc46", "name": "network-vif-deleted", "tag": "50d3b018-cc7a-4148-b6b4-82c83bfdfd59"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:00.481494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:00.481494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:09:00.490171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-9da5cdb5-13a5-4ebb-92dd-6eb3f863b8f7 req-aa469fe0-c134-46ef-bca2-0b2eb27ec9d4 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:00.490694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-9da5cdb5-13a5-4ebb-92dd-6eb3f863b8f7 req-aa469fe0-c134-46ef-bca2-0b2eb27ec9d4 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:00.512095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-9da5cdb5-13a5-4ebb-92dd-6eb3f863b8f7 req-aa469fe0-c134-46ef-bca2-0b2eb27ec9d4 service nova] Creating event network-vif-deleted:50d3b018-cc7a-4148-b6b4-82c83bfdfd59 for instance 89638f5a-769c-4331-b562-58ebf191dc46 on hv-cinder-82635 Jan 27 16:09:00.519496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-9da5cdb5-13a5-4ebb-92dd-6eb3f863b8f7 req-aa469fe0-c134-46ef-bca2-0b2eb27ec9d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195645 Jan 27 16:09:00.520519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 480/962] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:09:00.721168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:00.721775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:00.729801 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:00.730258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:00.731114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:00.731706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:00.879980 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:00.889273 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:00.891947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:00.893580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0096d6f6-a102-4676-ba13-ac828b73e3d3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.176494 Jan 27 16:09:00.895336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 483/963] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:00 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:01.145093 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:01.145703 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 89638f5a-769c-4331-b562-58ebf191dc46] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:01.153262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:01.153715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:01.154503 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:01.154945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:01.169249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] HTTP exception thrown: Instance 89638f5a-769c-4331-b562-58ebf191dc46 could not be found. Jan 27 16:09:01.169844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Returning 404 to user: Instance 89638f5a-769c-4331-b562-58ebf191dc46 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:09:01.170704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9f7d4640-8a68-4dc0-8b97-65dfd89db5be tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46" status: 404 len: 111 microversion: 2.1 time: 0.030750 Jan 27 16:09:01.171284 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 481/964] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:01 2022] GET /compute/v2.1/servers/89638f5a-769c-4331-b562-58ebf191dc46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:09:01.912728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:01.913326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:01.919558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:01.920004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:01.920775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:01.921206 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:02.059026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:02.068217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:02.070055 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:02.071228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1a692127-e110-4c73-a65e-06c3885a4da0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.162188 Jan 27 16:09:02.071776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 484/965] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:01 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:03.089580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:03.090181 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:03.096664 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:03.097113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:03.097899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:03.098820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:03.238225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:03.246634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:03.248153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:03.249289 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1c504112-a18b-4505-9681-f7709778605a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.163525 Jan 27 16:09:03.249844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 482/966] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:03 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:04.268757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:04.269367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:04.276004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:04.276465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:04.277263 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:04.277704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:04.406851 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:04.415369 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:04.416861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:04.418012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f60ce3d3-3aa1-441b-81c9-1924fb12c417 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.153633 Jan 27 16:09:04.418563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 485/967] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:04 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:05.436226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:05.436836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:05.443140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:05.443601 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:05.444388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:05.444832 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:05.577934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:05.586659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:05.588220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:05.589365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1c1dd6e0-f40c-402b-9bfc-ffe94637a3ab tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.156848 Jan 27 16:09:05.589971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 483/968] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:05 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:06.608786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:06.609425 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:06.616628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:06.617065 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:06.617848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:06.618284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:06.749859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:06.758149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:06.759673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:06.760817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b118e929-0b95-4e33-92ec-5f4c92729055 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.155815 Jan 27 16:09:06.761366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 486/969] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:06 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:07.778855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:07.779529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:07.785733 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:07.786172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:07.786938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:07.787391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:07.915117 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:07.923983 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:07.925470 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:07.926647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bfc6da16-98b8-4c71-ad7f-493365b95470 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.151474 Jan 27 16:09:07.927222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 484/970] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:07 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:08.944430 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:08.945184 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:08.951542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:08.951993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:08.952764 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:08.953879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:09.084558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:09.092688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:09.094179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:09.095340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-abfd00a8-2476-44f5-a642-3ca01b0e049a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.154563 Jan 27 16:09:09.095898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 487/971] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:08 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:10.114199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:10.114803 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:10.120576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:10.121032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:10.121820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:10.122308 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:10.254858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:10.263442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:10.264952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:10.266670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0955bf6a-9878-4ff4-b718-637150617173 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.157032 Jan 27 16:09:10.267260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 485/972] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:10 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:11.286908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:11.287546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:11.293548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:11.294001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:11.294781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:11.295244 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:11.423249 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:11.431697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:11.433201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:11.434350 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-da674346-98cb-4193-b242-4a96cdf5cffe tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.151549 Jan 27 16:09:11.434897 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 488/973] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:11 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:12.316313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-194a8d13-070f-4273-89f9-b669e0bef7a1 req-53ecc469-de46-45ea-937b-361a4c524167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb168b3-a714-4f0b-aca9-d23922390178", "name": "network-vif-plugged", "status": "completed", "tag": "7f3911ec-edec-4658-b029-6a522d1a3093"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:12.317831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:12.317831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:09:12.324636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-194a8d13-070f-4273-89f9-b669e0bef7a1 req-53ecc469-de46-45ea-937b-361a4c524167 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:12.325075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-194a8d13-070f-4273-89f9-b669e0bef7a1 req-53ecc469-de46-45ea-937b-361a4c524167 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:12.335465 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-194a8d13-070f-4273-89f9-b669e0bef7a1 req-53ecc469-de46-45ea-937b-361a4c524167 service nova] Creating event network-vif-plugged:7f3911ec-edec-4658-b029-6a522d1a3093 for instance ffb168b3-a714-4f0b-aca9-d23922390178 on hv-cinder-82635 Jan 27 16:09:12.340791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-194a8d13-070f-4273-89f9-b669e0bef7a1 req-53ecc469-de46-45ea-937b-361a4c524167 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139929 Jan 27 16:09:12.341794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 486/974] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:09:12.452401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:12.453517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:12.459824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:12.460275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:12.461054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:12.461490 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:12.596576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:12.604955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:12.606446 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:12.607645 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-53e04710-d1d0-4cdc-b17f-b2ca29c87e1b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.159012 Jan 27 16:09:12.608187 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 489/975] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:12 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:13.628599 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:13.629445 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:13.636452 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:13.636908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:13.637696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:13.638136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:13.769227 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:13.777283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:13.778781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:13.779960 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7819a066-cf92-44dc-9f61-016ebd734bcc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.157223 Jan 27 16:09:13.780520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 487/976] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:13 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:14.798173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:14.798776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:14.805147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:14.805601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:14.806385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:14.806820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:14.933155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:14.941225 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:14.942708 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:14.943878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-60da5751-ac59-43f3-9bf8-51889b59a888 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.149998 Jan 27 16:09:14.944436 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 490/977] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:14 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:15.963054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:15.963649 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:15.969913 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:15.970357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:15.971177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:15.971608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:16.136740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-633920641", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "9564f5ab-b5b0-4731-93e1-698de8676e63"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:16.139928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:16.148084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:16.149568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:16.150725 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-efd84532-4f9e-4798-8b7f-b74545b70571 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.192606 Jan 27 16:09:16.151298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 488/978] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:15 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:16.187378 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] validate_networks() for [('9564f5ab-b5b0-4731-93e1-698de8676e63', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:09:16.616337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:09:16.616753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:09:16.617215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:09:16.617614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:09:16.618018 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:09:16.626421 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:16.626860 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:16.627703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:16.628132 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:16.643928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Getting quotas for project 9f9b239b5a37482a93c714c4cff8d675. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:09:16.647650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Getting quotas for user 938fbc3632a84ce88d5ecb42681ada96 and project 9f9b239b5a37482a93c714c4cff8d675. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:09:16.658602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:09:16.660879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:09:16.704967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c3840340-c56c-47d0-8021-cfbf958faf01 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571682 Jan 27 16:09:16.705521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 491/979] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 27 16:09:16.714967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b64224dd-b80f-4308-be16-615689f48637 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:16.715605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b64224dd-b80f-4308-be16-615689f48637 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:16.767530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b64224dd-b80f-4308-be16-615689f48637 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:16.773914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b64224dd-b80f-4308-be16-615689f48637 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1218 microversion: 2.1 time: 0.062528 Jan 27 16:09:16.774477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 489/980] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:16 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:17.169288 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:17.169989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:17.175979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:17.176438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:17.177231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:17.177673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:17.311441 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:17.321063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:17.322587 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:17.323794 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4994f196-3d17-4c29-9f2d-d7f62bf58330 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.158653 Jan 27 16:09:17.324345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 492/981] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:17 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:17.791111 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:17.791734 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:17.798493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:17.799033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:17.800237 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:17.800760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:17.891195 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:17.899415 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-663e809f-81e3-497c-97cd-d59dcf96eb0d tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1276 microversion: 2.1 time: 0.111789 Jan 27 16:09:17.899996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 490/982] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:17 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:18.344148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:18.344876 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:18.352348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:18.353073 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:18.354044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:18.359522 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:18.515768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:18.523987 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:18.525497 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:18.526645 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-50c6e5fa-1eeb-4366-9c57-40b277af0613 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1807 microversion: 2.20 time: 0.187598 Jan 27 16:09:18.527225 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 493/983] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:18 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:18.916288 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:18.916920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:18.923260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:18.923700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:18.924478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:18.924909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:19.095703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-105607ed-609c-4c58-a530-faaa09900e55 req-d35d94f9-a85b-48e3-82e5-c1e162f8a265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "741edcad-c387-4e4d-bf96-fcea9873c0cd", "tag": "b88cd5cd-e298-44bf-bba0-12d46ed8ba33"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:19.098312 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:19.098312 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:09:19.104946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-105607ed-609c-4c58-a530-faaa09900e55 req-d35d94f9-a85b-48e3-82e5-c1e162f8a265 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:19.105575 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-105607ed-609c-4c58-a530-faaa09900e55 req-d35d94f9-a85b-48e3-82e5-c1e162f8a265 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:19.117511 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-105607ed-609c-4c58-a530-faaa09900e55 req-d35d94f9-a85b-48e3-82e5-c1e162f8a265 service nova] Creating event network-changed:b88cd5cd-e298-44bf-bba0-12d46ed8ba33 for instance 741edcad-c387-4e4d-bf96-fcea9873c0cd on hv-cinder-82635 Jan 27 16:09:19.123033 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-105607ed-609c-4c58-a530-faaa09900e55 req-d35d94f9-a85b-48e3-82e5-c1e162f8a265 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031568 Jan 27 16:09:19.123792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 494/984] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:09:19.176174 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:19.183555 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f4f9a2d6-3601-4920-a156-5f91bf97424f tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.270853 Jan 27 16:09:19.184143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 491/985] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:18 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:19.546864 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:19.547614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:19.553886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:19.554327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:19.555148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:19.555584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:19.701800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:19.710495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:19.712053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:19.713504 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-52f02327-ddc5-4b2d-a015-c3846010cb16 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1794 microversion: 2.20 time: 0.171120 Jan 27 16:09:19.714073 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 495/986] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:09:19 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1794 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:09:20.200375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:20.200983 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:20.209760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:20.210209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:20.211024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:20.211499 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:20.350128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:20.359214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c12fca20-4765-43c1-98e2-2d19555ad143 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.161951 Jan 27 16:09:20.359790 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 492/987] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:20 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:21.376616 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:21.377413 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:21.383806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:21.384258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:21.385049 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:21.385488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:21.517793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:21.525168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b29fbcc5-3011-43a9-82eb-d4daa426f8c2 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.152779 Jan 27 16:09:21.525728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 496/988] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:21 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:22.541707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:22.542350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:22.550198 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:22.550697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:22.551623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:22.552145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:22.686779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:22.694152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4d8ce343-b18e-4dff-a7f1-19834b38ff45 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.156119 Jan 27 16:09:22.694726 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 493/989] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:22 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:23.711995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:23.712731 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:23.718814 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:23.719312 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:23.720103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:23.720540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:23.849599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:23.856716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9ef8c21b-659f-43fb-83e7-e15bcd8521e7 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.149520 Jan 27 16:09:23.857268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 497/990] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:23 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:09:24.873780 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:24.874386 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:24.880753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:24.881208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:24.881990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:24.882429 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:25.007182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:25.014782 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0a2cd755-fad2-4cf6-aa5f-1935ca8dc127 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.144184 Jan 27 16:09:25.015365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 494/991] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:24 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:25.794379 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1522132237", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1848046509", "security_groups": [{"name": "tempest-secgroup-smoke-1212926962"}], "networks": [{"uuid": "be4781d7-03d6-47f6-88f7-8f665393817a"}], "block_device_mapping_v2": [{"uuid": "c22bd937-8c1e-4c44-be5c-d4a376063f25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:25.908919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] validate_networks() for [('be4781d7-03d6-47f6-88f7-8f665393817a', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:09:26.031377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:26.032030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:26.038433 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:26.038886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:26.039705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:26.040153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:26.176750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:26.187969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e8aea9ad-c014-4f7e-bb49-0fa4cd85900c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.159926 Jan 27 16:09:26.189545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 495/992] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:26 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:09:26.272233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-ad279b31-fc79-4c76-9127-caa57ae2c3ad req-ab8b85ae-b65b-4889-b3f3-3e6c861386ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741edcad-c387-4e4d-bf96-fcea9873c0cd", "name": "network-vif-plugged", "status": "completed", "tag": "b88cd5cd-e298-44bf-bba0-12d46ed8ba33"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:26.274377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:26.274377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:09:26.282067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:09:26.282425 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-ad279b31-fc79-4c76-9127-caa57ae2c3ad req-ab8b85ae-b65b-4889-b3f3-3e6c861386ce service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:26.282640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:09:26.282877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-ad279b31-fc79-4c76-9127-caa57ae2c3ad req-ab8b85ae-b65b-4889-b3f3-3e6c861386ce service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:26.283264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:09:26.283960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:09:26.284565 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:09:26.294109 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:26.294867 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:26.295145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-ad279b31-fc79-4c76-9127-caa57ae2c3ad req-ab8b85ae-b65b-4889-b3f3-3e6c861386ce service nova] Creating event network-vif-plugged:b88cd5cd-e298-44bf-bba0-12d46ed8ba33 for instance 741edcad-c387-4e4d-bf96-fcea9873c0cd on hv-cinder-82635 Jan 27 16:09:26.295766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:26.296198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:26.300799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-ad279b31-fc79-4c76-9127-caa57ae2c3ad req-ab8b85ae-b65b-4889-b3f3-3e6c861386ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Jan 27 16:09:26.301974 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 496/993] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:09:26.313395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Getting quotas for project 1c3096dd728a485190c1c92efa3850e3. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:09:26.317394 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Getting quotas for user a046e67fe14e47e6b1a0442abb7cb58f and project 1c3096dd728a485190c1c92efa3850e3. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:09:26.375043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:09:26.377393 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c22bd937-8c1e-4c44-be5c-d4a376063f25',volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:09:26.504242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-50a7063d-7538-41c2-a863-0a7ba59143ef tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716775 Jan 27 16:09:26.504883 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 498/994] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:09:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:09:26.515817 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4df45611-0620-415b-8904-dc6b6895bb70 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:26.516526 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4df45611-0620-415b-8904-dc6b6895bb70 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:26.579525 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4df45611-0620-415b-8904-dc6b6895bb70 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:26.586214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4df45611-0620-415b-8904-dc6b6895bb70 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1089 microversion: 2.1 time: 0.074679 Jan 27 16:09:26.586864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 497/995] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:26 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:27.205277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:27.205881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:27.212377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:27.212837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:27.213613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:27.214051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:27.342441 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:27.349918 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a3b89dfb-a4c7-4c55-a8cb-74806d73e135 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1318 microversion: 2.1 time: 0.148775 Jan 27 16:09:27.350488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 499/996] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:27 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:27.602022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:27.602925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:27.611513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:27.612075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:27.613121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:27.613696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:27.695434 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:27.702827 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-baa94247-a223-411e-8de1-b8476460914b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1205 microversion: 2.1 time: 0.104537 Jan 27 16:09:27.703509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 498/997] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:27 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1205 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:28.366943 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:28.367579 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:28.373899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:28.374336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:28.375163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:28.375632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:28.510347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:28.517578 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fe067c58-2caf-4bf1-b916-5a565213bf99 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1507 microversion: 2.1 time: 0.154342 Jan 27 16:09:28.518139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 500/998] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:28 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:28.534157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6c87610b-f6d4-413f-a929-11ab5303ddb0 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "682d4314-c094-4642-8272-5b2c67d2dbe3", "device": "/dev/sdb"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:28.535253 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6c87610b-f6d4-413f-a929-11ab5303ddb0 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:28.541029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6c87610b-f6d4-413f-a929-11ab5303ddb0 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:28.541471 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6c87610b-f6d4-413f-a929-11ab5303ddb0 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:28.542244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6c87610b-f6d4-413f-a929-11ab5303ddb0 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:28.542677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6c87610b-f6d4-413f-a929-11ab5303ddb0 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:28.723082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:28.723458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:28.730014 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:28.731249 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:28.732753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:28.733195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:28.928550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:28.938939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4be08ec5-4edf-4466-af62-51596a98132a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.219947 Jan 27 16:09:28.940059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 501/999] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:28 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:28.944759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-cc6ef1b2-7e1c-4a71-9a51-9fbf9dfed8c9 req-db85c09f-d361-4932-a882-0fea83663bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325464d0-4037-487b-b9b3-c71fb19fb437", "tag": "ad7c7c1a-2840-4fc3-8560-37a45a3feea6"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:28.946671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:28.946671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:09:28.957144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-cc6ef1b2-7e1c-4a71-9a51-9fbf9dfed8c9 req-db85c09f-d361-4932-a882-0fea83663bdd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:28.957705 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-cc6ef1b2-7e1c-4a71-9a51-9fbf9dfed8c9 req-db85c09f-d361-4932-a882-0fea83663bdd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:28.971501 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-cc6ef1b2-7e1c-4a71-9a51-9fbf9dfed8c9 req-db85c09f-d361-4932-a882-0fea83663bdd service nova] Creating event network-changed:ad7c7c1a-2840-4fc3-8560-37a45a3feea6 for instance 325464d0-4037-487b-b9b3-c71fb19fb437 on hv-cinder-82635 Jan 27 16:09:28.976854 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6c87610b-f6d4-413f-a929-11ab5303ddb0 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "POST /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446283 Jan 27 16:09:28.977401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-cc6ef1b2-7e1c-4a71-9a51-9fbf9dfed8c9 req-db85c09f-d361-4932-a882-0fea83663bdd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035665 Jan 27 16:09:28.977959 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 502/1000] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:09:28.978821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 499/1001] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:09:28 2022] POST /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:09:29.956921 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:29.957694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:29.964569 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:29.965024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:29.965831 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:29.966275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:30.105519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:30.114634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-022169f0-bd3f-4ec8-8405-d3ef996a372a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.161724 Jan 27 16:09:30.115225 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 503/1002] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:29 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:31.132391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:31.133112 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:31.139562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:31.140017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:31.140804 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:31.141245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:31.275286 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:31.283356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fc48b4ad-6f32-4716-9905-6bd182122c9a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.155392 Jan 27 16:09:31.283911 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 500/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:31 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:32.300277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:32.300812 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:32.307474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:32.307924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:32.308699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:32.309130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:32.436688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:32.444533 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-193502ac-4378-4f9b-a497-5e5f57f08128 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.147932 Jan 27 16:09:32.445094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 504/1004] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:32 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:33.461416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:33.462030 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:33.468488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:33.468882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:33.469674 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:33.470113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:33.598002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:33.605361 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bfc8c01d-215c-4f6c-bffd-86c8565b1601 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.147595 Jan 27 16:09:33.605908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 501/1005] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:33 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:34.622326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:34.623037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:34.629588 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:34.630040 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:34.630833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:34.631294 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:34.762582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:34.770337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-85385c57-e89d-4094-9127-734a9a0b0699 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.151763 Jan 27 16:09:34.770895 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 505/1006] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:34 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:35.788951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:35.789562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:35.795925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:35.796383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:35.797189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:35.797625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:35.925973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:35.933147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b474b771-bbd1-456a-beae-91ff5b7be71f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.149416 Jan 27 16:09:35.933698 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 502/1007] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:35 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:36.950063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:36.951343 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:36.957600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:36.958047 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:36.958830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:36.959289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:37.088480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:37.102642 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6c65a644-19a3-415e-969a-4e0dd63595fe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.154783 Jan 27 16:09:37.103511 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 506/1008] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:36 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:38.122225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:38.123519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:38.129729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:38.130171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:38.130940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:38.131400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:38.260725 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:38.268474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2dcc21ac-5d4a-4e3d-89c3-79b5aa1a423b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.149971 Jan 27 16:09:38.269016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 503/1009] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:38 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:39.285462 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:39.286017 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:39.292182 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:39.292626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:39.293392 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:39.293822 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:39.425361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:39.433106 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6104aeab-bad1-40e3-9cd1-0b76c654e8db tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.151318 Jan 27 16:09:39.433678 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 507/1010] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:39 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:40.449575 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:40.450176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:40.456573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:40.457011 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:40.457789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:40.458231 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:40.584125 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:40.591944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-77007377-7778-4e0f-a117-f43d3d162411 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.145407 Jan 27 16:09:40.592447 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 504/1011] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:40 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:41.609031 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:41.609648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:41.615881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:41.616340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:41.617139 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:41.617716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:41.754248 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:41.761546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c192488e-44c8-4e24-9da4-4a7301395bf6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.156899 Jan 27 16:09:41.762101 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 508/1012] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:41 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:42.777433 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:42.778037 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:42.785647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:42.786215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:42.787034 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:42.787478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:42.929991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:42.937289 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f1c392e0-19f1-4691-a141-857f5c5a930b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.163577 Jan 27 16:09:42.937837 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 505/1013] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:42 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:43.953984 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:43.954572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:43.960871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:43.961322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:43.962098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:43.962527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:44.094344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:44.101844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-977661a8-9a41-44ae-a291-ee57590af693 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.151936 Jan 27 16:09:44.102507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 509/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:43 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:44.786106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-f2327552-fc75-4786-a1f4-0de8d6304195 req-7bbbb038-dd12-4227-b51c-6806470b0acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325464d0-4037-487b-b9b3-c71fb19fb437", "name": "network-vif-plugged", "status": "completed", "tag": "ad7c7c1a-2840-4fc3-8560-37a45a3feea6"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:44.787738 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:44.787738 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:09:44.795548 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-f2327552-fc75-4786-a1f4-0de8d6304195 req-7bbbb038-dd12-4227-b51c-6806470b0acd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:44.795818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-f2327552-fc75-4786-a1f4-0de8d6304195 req-7bbbb038-dd12-4227-b51c-6806470b0acd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:44.807100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-f2327552-fc75-4786-a1f4-0de8d6304195 req-7bbbb038-dd12-4227-b51c-6806470b0acd service nova] Creating event network-vif-plugged:ad7c7c1a-2840-4fc3-8560-37a45a3feea6 for instance 325464d0-4037-487b-b9b3-c71fb19fb437 on hv-cinder-82635 Jan 27 16:09:44.812594 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-f2327552-fc75-4786-a1f4-0de8d6304195 req-7bbbb038-dd12-4227-b51c-6806470b0acd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030080 Jan 27 16:09:44.813363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 506/1015] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:09:45.118889 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:45.119553 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:45.126489 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:45.126943 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:45.127835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:45.128274 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:45.257956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:45.265575 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5bb19bc2-d35b-4b48-a976-943f21deaf0b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.150328 Jan 27 16:09:45.266129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 510/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:45 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:46.283467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:46.284069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:46.290049 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:46.290492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:46.291286 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:46.291719 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:46.419659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:46.426838 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4602a6b9-f50c-443f-b722-45d275a335c0 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.148438 Jan 27 16:09:46.427420 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 507/1017] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:46 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:47.444053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:47.444680 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:47.451707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:47.452168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:47.452970 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:47.453416 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:47.583427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:47.591484 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-86175424-52d7-4df3-bb21-4157038840e3 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.150937 Jan 27 16:09:47.595126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 511/1018] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:47 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:48.608076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:48.608718 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:48.615467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:48.615926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:48.616724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:48.617167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:48.753274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:48.760728 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fba9935d-f404-423c-a5c7-8c26a2ab902d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1261 microversion: 2.1 time: 0.156384 Jan 27 16:09:48.761306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 508/1019] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:48 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:49.777783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:49.779079 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:49.787670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:49.788238 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:49.789172 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:49.789738 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:49.935300 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:49.942789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ba53508f-2fb1-4426-970b-3dca84d7c4f2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1445 microversion: 2.1 time: 0.168972 Jan 27 16:09:49.943396 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 512/1020] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:49 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:49.958847 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:49.959700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:49.966374 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:49.966825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:49.967634 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:49.968069 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:50.097986 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:50.105303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7924efa5-a8f1-4441-8805-424633cb2e3a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1445 microversion: 2.1 time: 0.150089 Jan 27 16:09:50.105860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 509/1021] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:49 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:50.346188 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:09:50.346590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:09:51.317745 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:51.318363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:51.324466 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:51.324931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:51.325703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:51.326130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:51.407544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lazy-loading 'services' on Instance uuid 741edcad-c387-4e4d-bf96-fcea9873c0cd {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:09:51.479226 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2614ea61-f3c0-42bc-ad9c-827de19fb2f6 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "DELETE /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd/os-volume_attachments/682d4314-c094-4642-8272-5b2c67d2dbe3" status: 202 len: 0 microversion: 2.1 time: 0.165054 Jan 27 16:09:51.479917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 513/1022] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:09:51 2022] DELETE /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd/os-volume_attachments/682d4314-c094-4642-8272-5b2c67d2dbe3 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:09:52.113588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-ed269709-946e-47cc-990f-d6fe4b688f17 req-6dbeefeb-96e5-48b6-9e37-520faf22b2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325464d0-4037-487b-b9b3-c71fb19fb437", "tag": "ad7c7c1a-2840-4fc3-8560-37a45a3feea6"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:52.113588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:52.113588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:09:52.120590 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-ed269709-946e-47cc-990f-d6fe4b688f17 req-6dbeefeb-96e5-48b6-9e37-520faf22b2fc service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:52.121161 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-ed269709-946e-47cc-990f-d6fe4b688f17 req-6dbeefeb-96e5-48b6-9e37-520faf22b2fc service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:52.133060 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-ed269709-946e-47cc-990f-d6fe4b688f17 req-6dbeefeb-96e5-48b6-9e37-520faf22b2fc service nova] Creating event network-changed:ad7c7c1a-2840-4fc3-8560-37a45a3feea6 for instance 325464d0-4037-487b-b9b3-c71fb19fb437 on hv-cinder-82635 Jan 27 16:09:52.138005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-ed269709-946e-47cc-990f-d6fe4b688f17 req-6dbeefeb-96e5-48b6-9e37-520faf22b2fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Jan 27 16:09:52.138693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 510/1023] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:09:52.594925 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:52.595536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:52.602177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:52.602622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:52.603445 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:52.603880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:52.630856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:09:52.718692 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2d62489c-5429-4821-8383-a1ab17149d1c tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "DELETE /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 204 len: 0 microversion: 2.1 time: 0.128216 Jan 27 16:09:52.720177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 514/1024] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:09:52 2022] DELETE /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:09:52.729283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:52.730273 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:52.736754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:52.737145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:52.737934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:52.738367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:52.873571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:52.881190 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0a5563d5-3566-4993-b99b-cc7f8c023a49 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1513 microversion: 2.1 time: 0.156201 Jan 27 16:09:52.881782 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 511/1025] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:52 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:53.899145 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:53.899877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:53.906499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:53.906950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:53.907762 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:53.908201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:54.035427 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:54.042785 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a60cc59b-3578-413b-98dd-612b0e7f1123 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1513 microversion: 2.1 time: 0.147723 Jan 27 16:09:54.043369 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 515/1026] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:53 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:55.058929 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:55.059562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:55.065903 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:55.066349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:55.067172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:55.067663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:55.273144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938fbc3632a84ce88d5ecb42681ada96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9b239b5a37482a93c714c4cff8d675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:55.280467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-13d28d2d-ebd8-4d1e-b5cf-def0d798b191 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 200 len: 1513 microversion: 2.1 time: 0.225527 Jan 27 16:09:55.281121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 512/1027] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:55 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:55.600562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-2807bb2a-3549-4d00-9949-1f523cc490ba req-a0bdd1d2-2b2b-4eb0-a7cd-916eff218050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741edcad-c387-4e4d-bf96-fcea9873c0cd", "name": "network-vif-deleted", "tag": "b88cd5cd-e298-44bf-bba0-12d46ed8ba33"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:55.602137 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:09:55.602137 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:09:55.610274 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-2807bb2a-3549-4d00-9949-1f523cc490ba req-a0bdd1d2-2b2b-4eb0-a7cd-916eff218050 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:55.610716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-2807bb2a-3549-4d00-9949-1f523cc490ba req-a0bdd1d2-2b2b-4eb0-a7cd-916eff218050 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:55.622305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-2807bb2a-3549-4d00-9949-1f523cc490ba req-a0bdd1d2-2b2b-4eb0-a7cd-916eff218050 service nova] Creating event network-vif-deleted:b88cd5cd-e298-44bf-bba0-12d46ed8ba33 for instance 741edcad-c387-4e4d-bf96-fcea9873c0cd on hv-cinder-82635 Jan 27 16:09:55.627190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-2807bb2a-3549-4d00-9949-1f523cc490ba req-a0bdd1d2-2b2b-4eb0-a7cd-916eff218050 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030162 Jan 27 16:09:55.627814 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 516/1028] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:09:56.144730 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:56.145236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:56.151097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:56.151543 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:56.152861 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:56.153288 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:56.228553 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lazy-loading 'services' on Instance uuid 3f3d80d1-f3b7-4435-853e-6c267367f0f9 {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:09:56.295829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4a1b17e9-dfde-49cf-b576-fc06c3618766 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-volume_attachments/b8a0b4a3-e8c1-4038-aa19-d5a559b30dd2" status: 202 len: 0 microversion: 2.1 time: 0.263102 Jan 27 16:09:56.296438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 513/1029] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:09:56 2022] DELETE /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-volume_attachments/b8a0b4a3-e8c1-4038-aa19-d5a559b30dd2 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:09:56.298075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:56.298954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] [instance: 741edcad-c387-4e4d-bf96-fcea9873c0cd] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:56.305284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:56.305730 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:56.306517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:56.306946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:56.320711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] HTTP exception thrown: Instance 741edcad-c387-4e4d-bf96-fcea9873c0cd could not be found. Jan 27 16:09:56.321297 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] Returning 404 to user: Instance 741edcad-c387-4e4d-bf96-fcea9873c0cd could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:09:56.322205 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b3b902ff-ac31-4537-8ccd-3d6c433012c3 tempest-VolumesSnapshotTestJSON-867961517 tempest-VolumesSnapshotTestJSON-867961517-project] 10.222.0.61 "GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd" status: 404 len: 111 microversion: 2.1 time: 0.028851 Jan 27 16:09:56.322743 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 517/1030] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:56 2022] GET /compute/v2.1/servers/741edcad-c387-4e4d-bf96-fcea9873c0cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:09:58.461112 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a2e40d11-b2f8-48a2-9cd6-41cfcebc36b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:09:58.467852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a2e40d11-b2f8-48a2-9cd6-41cfcebc36b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:58.468301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a2e40d11-b2f8-48a2-9cd6-41cfcebc36b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:58.490129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a2e40d11-b2f8-48a2-9cd6-41cfcebc36b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Going to try to stop instance {{(pid=116260) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 27 16:09:58.536737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a2e40d11-b2f8-48a2-9cd6-41cfcebc36b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 202 len: 0 microversion: 2.1 time: 0.079962 Jan 27 16:09:58.537328 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 514/1031] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:09:58 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:09:58.546069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:58.546683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:58.553295 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:58.553753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:58.554568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:58.555163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:58.681433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:58.688747 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0ab69d16-e0fd-4686-af15-cf5888e1cb4f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.146992 Jan 27 16:09:58.689303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 518/1032] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:58 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:09:59.706829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:09:59.707562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:09:59.713587 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:59.714027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:59.715145 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:09:59.715578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:09:59.852101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:09:59.860282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5468023b-9c85-4ebf-a266-0a689ac10bbb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.157900 Jan 27 16:09:59.860843 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 515/1033] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:09:59 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:00.878209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:00.878813 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:00.885088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:00.885562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:00.886861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:00.887330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:01.015746 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:01.022919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-27a6b2dd-6f4d-4af1-9324-e8f9631514fc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.148347 Jan 27 16:10:01.023500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 519/1034] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:00 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:02.040782 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:02.041391 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:02.048521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:02.048978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:02.049758 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:02.050202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:02.180676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:02.188103 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5e3ecaf6-bb22-4b86-96f4-61e7adc9ebe0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.151115 Jan 27 16:10:02.188659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 516/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:02 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:03.205007 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:03.205705 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:03.212222 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:03.212771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:03.213638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:03.214200 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:03.346012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:03.353300 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7e1ca53a-330f-4c42-bec9-17c74fae866a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.152026 Jan 27 16:10:03.353856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 520/1036] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:03 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:04.371326 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:04.371971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:04.378324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:04.378835 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:04.379836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:04.380348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:04.505110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:04.513449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-202ead7a-818a-4aeb-b210-03a1f6b62728 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.146863 Jan 27 16:10:04.513941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 517/1037] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:04 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:05.531259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:05.531952 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:05.537989 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:05.538433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:05.539231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:05.539661 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:05.677871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:05.685580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-76437854-7aae-42f4-ae1d-bdecd87f6979 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.158683 Jan 27 16:10:05.686141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 521/1038] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:05 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:06.705106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:06.705705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:06.711909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:06.712355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:06.713129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:06.713560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:06.858363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:06.866657 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dbe2be7b-bbbe-4e64-a88d-a5c6a5df6c40 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.165181 Jan 27 16:10:06.867262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 518/1039] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:06 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:07.884893 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:07.885499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:07.891695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:07.892218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:07.893172 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:07.893984 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:08.023939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:08.031627 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-800b4322-264f-4973-8feb-c3e3960c3ee9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.150338 Jan 27 16:10:08.032170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 522/1040] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:07 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:09.048344 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:09.048947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:09.055258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:09.055714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:09.056490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:09.056938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:09.184393 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:09.191826 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c51c0f23-531a-48c3-a2ea-d024a985c358 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.147095 Jan 27 16:10:09.192388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 519/1041] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:09 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:10.207945 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:10.208485 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:10.214998 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:10.215443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:10.216211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:10.216639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:10.348955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:10.356178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0a563c0e-cc76-42f4-a19f-ebb5435c1345 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.152094 Jan 27 16:10:10.356735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 523/1042] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:10 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:11.373438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:11.374046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:11.380348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:11.380802 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:11.381581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:11.382016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:11.526963 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:11.534561 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-25634ca6-275a-4a9f-8602-37345729edf0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.164747 Jan 27 16:10:11.535150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 520/1043] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:11 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:12.555307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:12.555849 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:12.562339 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:12.562787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:12.563605 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:12.564045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:12.697667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:12.705216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b4faf798-9e4b-41ca-ad35-f342c2026470 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.153778 Jan 27 16:10:12.705769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 524/1044] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:12 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:13.723107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:13.723753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:13.731170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:13.731622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:13.732523 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:13.732995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:13.863902 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:13.873258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f917780f-460a-4ec9-bd5b-06ee9008a82c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.153553 Jan 27 16:10:13.874228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 521/1045] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:13 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:10:14.895030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:14.895624 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:14.901912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:14.902372 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:14.903190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:14.903629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:15.036756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:15.044072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7c543204-e761-45ce-a059-9fd56cb2074f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.152773 Jan 27 16:10:15.044633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 525/1046] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:14 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:16.061528 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:16.062128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:16.068492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:16.068940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:16.069723 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:16.070153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:16.198098 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:16.205314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7035594a-998c-4b89-aaf0-9c96bfddc471 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.148064 Jan 27 16:10:16.205880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 522/1047] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:16 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:17.222189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:17.222781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:17.229082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:17.229537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:17.230320 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:17.230759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:17.360147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:17.367714 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-04c2818d-fa6b-40ac-92bb-5c70be308e6f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.149194 Jan 27 16:10:17.368271 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 526/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:17 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:18.385179 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:18.385773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:18.392124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:18.392577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:18.393352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:18.393787 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:18.524136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:18.531899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a3296476-fbf5-4d36-9d82-85a723edf370 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.150451 Jan 27 16:10:18.532463 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 523/1049] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:18 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:19.547961 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:19.548572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:19.554910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:19.555398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:19.556220 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:19.556658 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:19.686303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:19.693577 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bf4c8165-6af4-4a50-b2ac-785ccb3cbe31 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.149242 Jan 27 16:10:19.694152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 527/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:19 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:20.710490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:20.711092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:20.717986 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:20.718441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:20.719283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:20.719730 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:20.849553 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:20.856968 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0a94cc30-82c2-4991-8ddc-ac683bb6952b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.150128 Jan 27 16:10:20.857538 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 524/1051] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:20 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:21.873955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:21.874590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:21.881233 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:21.881694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:21.882497 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:21.882955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:22.047415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:22.054853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1103890f-94ce-4fe4-aa14-1f4e6bca46a3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1677 microversion: 2.1 time: 0.184561 Jan 27 16:10:22.055444 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 528/1052] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:21 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:23.071736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:23.072352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:23.079257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:23.079704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:23.080480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:23.080911 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:23.213357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:23.222330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ca949aac-9d29-45f1-a941-9ac34afee7ba tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1654 microversion: 2.1 time: 0.154222 Jan 27 16:10:23.222891 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 525/1053] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:23 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:23.238433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fdf60a0f-1047-477f-9d04-91ed69cb47c3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:10:23.245258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fdf60a0f-1047-477f-9d04-91ed69cb47c3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:23.245694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fdf60a0f-1047-477f-9d04-91ed69cb47c3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:23.268150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fdf60a0f-1047-477f-9d04-91ed69cb47c3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Going to try to start instance {{(pid=116261) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 27 16:10:23.308781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fdf60a0f-1047-477f-9d04-91ed69cb47c3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action" status: 202 len: 0 microversion: 2.1 time: 0.073800 Jan 27 16:10:23.309445 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 529/1054] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:10:23 2022] POST /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:10:23.317662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:23.318278 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:23.325061 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:23.325441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:23.326314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:23.326747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:23.485970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:23.493519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-19c7a20b-c63b-411d-a9b9-0c5c1fa6b30e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1663 microversion: 2.1 time: 0.179624 Jan 27 16:10:23.494713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 526/1055] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:23 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:24.515832 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:24.516559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:24.526228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:24.526740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:24.527885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:24.528384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:24.670644 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:24.678227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-13752554-790d-40a3-adfc-2be45e199851 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1667 microversion: 2.1 time: 0.170156 Jan 27 16:10:24.678788 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 530/1056] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:10:24 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:42.440192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5b98ec87-b615-4184-8808-9f90db67af4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:42.440797 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5b98ec87-b615-4184-8808-9f90db67af4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:42.447263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b98ec87-b615-4184-8808-9f90db67af4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:42.447715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b98ec87-b615-4184-8808-9f90db67af4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:42.448498 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b98ec87-b615-4184-8808-9f90db67af4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:42.448932 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b98ec87-b615-4184-8808-9f90db67af4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:42.477377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5b98ec87-b615-4184-8808-9f90db67af4b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments/88205848-6f37-4d34-8312-0f8dde787fb4" status: 200 len: 194 microversion: 2.20 time: 0.041381 Jan 27 16:10:42.477951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 527/1057] 10.222.0.61 () {60 vars in 1453 bytes} [Thu Jan 27 16:10:42 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments/88205848-6f37-4d34-8312-0f8dde787fb4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:10:42.538879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:42.539433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:42.545267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:42.545702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:42.546463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:42.546890 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:42.623584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lazy-loading 'services' on Instance uuid ffb168b3-a714-4f0b-aca9-d23922390178 {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:10:42.692566 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b0b4fbdc-dcd7-4a97-ae9e-080f10c80511 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments/88205848-6f37-4d34-8312-0f8dde787fb4" status: 202 len: 0 microversion: 2.20 time: 0.157341 Jan 27 16:10:42.693149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 531/1058] 10.222.0.61 () {60 vars in 1456 bytes} [Thu Jan 27 16:10:42 2022] DELETE /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments/88205848-6f37-4d34-8312-0f8dde787fb4 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:10:42.702001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ac9022e8-4cbf-4392-858b-668e387bb862 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:42.702967 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ac9022e8-4cbf-4392-858b-668e387bb862 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:42.708970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac9022e8-4cbf-4392-858b-668e387bb862 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:42.709434 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac9022e8-4cbf-4392-858b-668e387bb862 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:42.710216 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac9022e8-4cbf-4392-858b-668e387bb862 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:42.710670 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac9022e8-4cbf-4392-858b-668e387bb862 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:42.740978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ac9022e8-4cbf-4392-858b-668e387bb862 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042749 Jan 27 16:10:42.741541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 528/1059] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Jan 27 16:10:42 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:10:43.754146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-87503f1f-528f-4a60-b33d-e8018418c52f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:43.755216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-87503f1f-528f-4a60-b33d-e8018418c52f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:43.762816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-87503f1f-528f-4a60-b33d-e8018418c52f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:43.763296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-87503f1f-528f-4a60-b33d-e8018418c52f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:43.764069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-87503f1f-528f-4a60-b33d-e8018418c52f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:43.764501 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-87503f1f-528f-4a60-b33d-e8018418c52f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:43.795198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-87503f1f-528f-4a60-b33d-e8018418c52f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045535 Jan 27 16:10:43.795751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 532/1060] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Jan 27 16:10:43 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:10:43.851630 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:43.852164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:43.858783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:43.859274 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:43.860084 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:43.860527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:43.885181 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:10:43.960880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-83f01a93-f58c-4a75-95bd-8670ec371df5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 204 len: 0 microversion: 2.20 time: 0.112507 Jan 27 16:10:43.962056 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 529/1061] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jan 27 16:10:43 2022] DELETE /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:10:43.970499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:43.971126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:43.976905 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:43.977351 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:43.978127 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:43.978558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:44.109109 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:44.116836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:44.118874 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:44.120048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a0ffef1b-63f9-4fca-8308-a9dadd85573d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.153211 Jan 27 16:10:44.120600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 533/1062] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:43 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:45.138585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:45.139292 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:45.145499 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:45.145952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:45.146735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:45.147209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:45.276365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:45.284083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:45.285584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:45.286734 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b104960f-dd71-4082-bd42-3523f82eb15f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.152239 Jan 27 16:10:45.287316 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 530/1063] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:45 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:46.306112 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:46.306719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:46.313808 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:46.314259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:46.315081 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:46.315519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:46.448037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:46.456975 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:46.459237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:46.460603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-482594a6-237b-49fd-bd96-9226fb5a930c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 200 len: 1722 microversion: 2.20 time: 0.158705 Jan 27 16:10:46.471398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 534/1064] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:46 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:46.732490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-91627eb3-0cd4-4594-8d17-4dc670282059 req-07e98220-5583-4ad0-9b41-c8fc31052191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb168b3-a714-4f0b-aca9-d23922390178", "name": "network-vif-deleted", "tag": "7f3911ec-edec-4658-b029-6a522d1a3093"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:10:46.734029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:10:46.734029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:10:46.741834 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-91627eb3-0cd4-4594-8d17-4dc670282059 req-07e98220-5583-4ad0-9b41-c8fc31052191 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:46.742707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-91627eb3-0cd4-4594-8d17-4dc670282059 req-07e98220-5583-4ad0-9b41-c8fc31052191 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:46.755350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-91627eb3-0cd4-4594-8d17-4dc670282059 req-07e98220-5583-4ad0-9b41-c8fc31052191 service nova] Creating event network-vif-deleted:7f3911ec-edec-4658-b029-6a522d1a3093 for instance ffb168b3-a714-4f0b-aca9-d23922390178 on hv-cinder-82635 Jan 27 16:10:46.761135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-91627eb3-0cd4-4594-8d17-4dc670282059 req-07e98220-5583-4ad0-9b41-c8fc31052191 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032443 Jan 27 16:10:46.762628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 531/1065] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:10:47.478163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:47.479396 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:47.486253 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:47.486711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:47.488228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:47.488824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:47.502853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] HTTP exception thrown: Instance ffb168b3-a714-4f0b-aca9-d23922390178 could not be found. Jan 27 16:10:47.503585 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Returning 404 to user: Instance ffb168b3-a714-4f0b-aca9-d23922390178 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:10:47.504452 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-08ff1873-20fb-4935-9a93-9620e4552683 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 404 len: 111 microversion: 2.20 time: 0.030098 Jan 27 16:10:47.505000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 535/1066] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:47 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:10:47.514527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b7051452-e41b-4c24-a0b9-559c4521bd1a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '.version_select at 0x7f78121db1f0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:47.537783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b7051452-e41b-4c24-a0b9-559c4521bd1a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-354944945" status: 204 len: 0 microversion: 2.20 time: 0.027353 Jan 27 16:10:47.538699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 532/1067] 10.222.0.61 () {60 vars in 1258 bytes} [Thu Jan 27 16:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-354944945 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:10:48.549433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-639f222f-6b42-4bce-b005-215bd7990183 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'create', calling method: .version_select at 0x7f781755f5e0>, body: {"keypair": {"name": "tempest-keypair-961076595"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:10:48.563464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-639f222f-6b42-4bce-b005-215bd7990183 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:10:48.567235 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-639f222f-6b42-4bce-b005-215bd7990183 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for user 1e42712b632b4a83848a75e00f258c65 and project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:10:48.658782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-639f222f-6b42-4bce-b005-215bd7990183 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:10:48.662449 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-639f222f-6b42-4bce-b005-215bd7990183 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for user 1e42712b632b4a83848a75e00f258c65 and project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:10:48.675904 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-639f222f-6b42-4bce-b005-215bd7990183 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.130325 Jan 27 16:10:48.676496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 536/1068] 10.222.0.61 () {62 vars in 1198 bytes} [Thu Jan 27 16:10:48 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:10:50.190870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-62907165", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ac1415e-ce93-45b8-8b83-dca773596e87"}], "security_groups": [{"name": "tempest-securitygroup--680560286"}], "key_name": "tempest-keypair-961076595", "user_data": "}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:10:50.299205 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] validate_networks() for [('3ac1415e-ce93-45b8-8b83-dca773596e87', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:10:50.662770 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:10:50.663172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:10:50.664157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:10:50.664563 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:10:50.664977 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:10:50.673680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:50.674124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:50.674928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:50.675394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:50.692633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:10:50.696740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Getting quotas for user 1e42712b632b4a83848a75e00f258c65 and project 89f6fa34c0ae441a8fcb708070986ea9. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:10:50.707547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:10:50.709992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:10:50.758048 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-428436b7-bfde-4ba9-870c-73164453bdf2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.571698 Jan 27 16:10:50.758700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 533/1069] 10.222.0.61 () {62 vars in 1187 bytes} [Thu Jan 27 16:10:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 27 16:10:50.768933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9fb7e09a-bb7d-42bf-bd16-e2ddd5f96070 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:50.769577 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9fb7e09a-bb7d-42bf-bd16-e2ddd5f96070 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:50.838360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9fb7e09a-bb7d-42bf-bd16-e2ddd5f96070 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:50.847224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9fb7e09a-bb7d-42bf-bd16-e2ddd5f96070 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:50.849092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9fb7e09a-bb7d-42bf-bd16-e2ddd5f96070 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:50.850228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9fb7e09a-bb7d-42bf-bd16-e2ddd5f96070 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1279 microversion: 2.20 time: 0.085508 Jan 27 16:10:50.850774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 537/1070] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:50 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:51.869723 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:51.870335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:51.877300 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:51.877747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:51.878533 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:51.878973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:51.976819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:51.984788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:51.986294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:51.987409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6d3fbf2a-cf33-4834-9c42-185dcdda1b79 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1337 microversion: 2.20 time: 0.122737 Jan 27 16:10:51.987966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 534/1071] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:51 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1337 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:53.005739 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:53.006499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:53.013437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:53.014036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:53.014933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:53.015646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:53.161059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:53.169903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:53.171442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:53.172990 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ba3f40b9-ab45-44a6-9757-9705a756f823 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1404 microversion: 2.20 time: 0.171158 Jan 27 16:10:53.174211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 538/1072] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:53 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:53.181678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-abe1c035-6554-45e3-ac75-e8cf18c98dae req-263fac6c-62c6-4038-a128-6cae36201475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2a1a78-ef34-45bd-ac94-52a498c00afc", "tag": "65f08781-43d4-4145-addc-4b4981e01510"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:10:53.187769 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:10:53.187769 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:10:53.203110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-abe1c035-6554-45e3-ac75-e8cf18c98dae req-263fac6c-62c6-4038-a128-6cae36201475 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:53.203556 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-abe1c035-6554-45e3-ac75-e8cf18c98dae req-263fac6c-62c6-4038-a128-6cae36201475 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:53.216865 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-abe1c035-6554-45e3-ac75-e8cf18c98dae req-263fac6c-62c6-4038-a128-6cae36201475 service nova] Creating event network-changed:65f08781-43d4-4145-addc-4b4981e01510 for instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc on hv-cinder-82635 Jan 27 16:10:53.222163 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-abe1c035-6554-45e3-ac75-e8cf18c98dae req-263fac6c-62c6-4038-a128-6cae36201475 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064764 Jan 27 16:10:53.222755 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 535/1073] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:10:54.191152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:54.191785 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:54.198084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:54.198525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:54.199339 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:54.199770 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:54.326399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:54.334026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:54.335528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:54.336606 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-54b2ef64-23b8-4c8b-b61f-8116d5aa2504 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1404 microversion: 2.20 time: 0.149170 Jan 27 16:10:54.337148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 539/1074] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:54 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:55.354743 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:55.355480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:55.361972 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:55.362424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:55.363238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:55.363702 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:55.495229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:55.502926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:55.504467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:55.505564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d0b9af80-e986-4a5c-bef3-7afda240fddb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1404 microversion: 2.20 time: 0.155341 Jan 27 16:10:55.506108 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 536/1075] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:55 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:56.524058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:56.524653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:56.530997 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:56.531461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:56.532243 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:56.532679 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:56.658449 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:56.666672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:56.668210 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:56.669296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9108bfb7-cecb-41e4-befa-cdff8974b05f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1404 microversion: 2.20 time: 0.149087 Jan 27 16:10:56.669847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 540/1076] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:56 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:57.687153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:57.687765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:57.694198 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:57.695252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:57.696058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:57.696501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:57.929622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:57.937485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:57.939003 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:57.940115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0a443ba9-4c23-4cab-8231-977115189667 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1404 microversion: 2.20 time: 0.256690 Jan 27 16:10:57.940668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 537/1077] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:57 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1404 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:10:58.957481 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:10:58.958096 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:10:58.965235 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:58.965852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:58.966719 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:58.967203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:59.037791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-3dc8e797-8b77-48f5-8db9-88a523298c6b req-5acfa7a4-3c11-4073-95f2-2b9410745c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2a1a78-ef34-45bd-ac94-52a498c00afc", "name": "network-vif-plugged", "status": "completed", "tag": "65f08781-43d4-4145-addc-4b4981e01510"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:10:59.039562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:10:59.039562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:10:59.046861 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-3dc8e797-8b77-48f5-8db9-88a523298c6b req-5acfa7a4-3c11-4073-95f2-2b9410745c3e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:10:59.047765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-3dc8e797-8b77-48f5-8db9-88a523298c6b req-5acfa7a4-3c11-4073-95f2-2b9410745c3e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:10:59.060826 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-3dc8e797-8b77-48f5-8db9-88a523298c6b req-5acfa7a4-3c11-4073-95f2-2b9410745c3e service nova] Creating event network-vif-plugged:65f08781-43d4-4145-addc-4b4981e01510 for instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc on hv-cinder-82635 Jan 27 16:10:59.066020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-3dc8e797-8b77-48f5-8db9-88a523298c6b req-5acfa7a4-3c11-4073-95f2-2b9410745c3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Jan 27 16:10:59.067097 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 538/1078] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:10:59.108181 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:59.116715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:59.118257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:10:59.119383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-24bdf941-e32f-4ea1-9504-fbd784bca6aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1404 microversion: 2.20 time: 0.165635 Jan 27 16:10:59.120228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 541/1079] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:10:58 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:11:00.138512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:00.139237 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:00.145830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:00.146283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:00.147101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:00.148132 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:00.275989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:00.283776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:00.285267 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:00.286348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5b946e3b-6fc1-4171-9d2c-7b2a88a3e995 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1404 microversion: 2.20 time: 0.151951 Jan 27 16:11:00.286964 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 539/1080] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:11:00 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:11:01.304641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:01.305262 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:01.311467 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:01.311916 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:01.312695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:01.313135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:01.440023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:01.449482 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:01.449482 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:01.450436 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f30954d4-100d-4055-bf3f-dc7035f938ff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1595 microversion: 2.20 time: 0.149549 Jan 27 16:11:01.451000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 542/1081] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:11:01 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1595 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:11:01.468365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-95b6e11e-b12e-4eba-9899-40a2e6f5344e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:01.468909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-95b6e11e-b12e-4eba-9899-40a2e6f5344e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:01.477355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-95b6e11e-b12e-4eba-9899-40a2e6f5344e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:01.478066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-95b6e11e-b12e-4eba-9899-40a2e6f5344e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:01.478855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-95b6e11e-b12e-4eba-9899-40a2e6f5344e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:01.479387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-95b6e11e-b12e-4eba-9899-40a2e6f5344e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:01.559196 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-95b6e11e-b12e-4eba-9899-40a2e6f5344e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094621 Jan 27 16:11:01.559783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 540/1082] 10.222.0.61 () {60 vars in 1315 bytes} [Thu Jan 27 16:11:01 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:11:02.728914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-506cadfc-03df-4ea0-abab-a1bf9283b1a7 req-b3ce8053-16ad-4ce2-8c61-84d412417120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2a1a78-ef34-45bd-ac94-52a498c00afc", "tag": "65f08781-43d4-4145-addc-4b4981e01510"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:02.730419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:11:02.730419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:11:02.734673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7095e4e9-00c2-4631-a86f-36c35890ce59 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:02.735618 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7095e4e9-00c2-4631-a86f-36c35890ce59 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:02.737873 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-506cadfc-03df-4ea0-abab-a1bf9283b1a7 req-b3ce8053-16ad-4ce2-8c61-84d412417120 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:02.738256 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-506cadfc-03df-4ea0-abab-a1bf9283b1a7 req-b3ce8053-16ad-4ce2-8c61-84d412417120 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:02.742527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7095e4e9-00c2-4631-a86f-36c35890ce59 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:02.742996 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7095e4e9-00c2-4631-a86f-36c35890ce59 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:02.743786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7095e4e9-00c2-4631-a86f-36c35890ce59 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:02.744450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7095e4e9-00c2-4631-a86f-36c35890ce59 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:02.750426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-506cadfc-03df-4ea0-abab-a1bf9283b1a7 req-b3ce8053-16ad-4ce2-8c61-84d412417120 service nova] Creating event network-changed:65f08781-43d4-4145-addc-4b4981e01510 for instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc on hv-cinder-82635 Jan 27 16:11:02.755402 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-506cadfc-03df-4ea0-abab-a1bf9283b1a7 req-b3ce8053-16ad-4ce2-8c61-84d412417120 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030981 Jan 27 16:11:02.759204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 541/1083] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:11:02.807967 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7095e4e9-00c2-4631-a86f-36c35890ce59 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.086777 Jan 27 16:11:02.808958 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 543/1084] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:02 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:03.820637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d51b9d2e-5bf6-4d01-8825-fcd72cfbd264 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:03.821690 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d51b9d2e-5bf6-4d01-8825-fcd72cfbd264 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:03.827882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d51b9d2e-5bf6-4d01-8825-fcd72cfbd264 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:03.828333 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d51b9d2e-5bf6-4d01-8825-fcd72cfbd264 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:03.829126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d51b9d2e-5bf6-4d01-8825-fcd72cfbd264 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:03.829564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d51b9d2e-5bf6-4d01-8825-fcd72cfbd264 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:03.895494 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d51b9d2e-5bf6-4d01-8825-fcd72cfbd264 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.079471 Jan 27 16:11:03.896153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 542/1085] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:03 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:04.906425 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0a1f2054-7f06-48d7-b4cf-e6ce1c0539a8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:04.907441 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0a1f2054-7f06-48d7-b4cf-e6ce1c0539a8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:04.914767 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a1f2054-7f06-48d7-b4cf-e6ce1c0539a8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:04.915232 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a1f2054-7f06-48d7-b4cf-e6ce1c0539a8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:04.916006 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a1f2054-7f06-48d7-b4cf-e6ce1c0539a8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:04.916431 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0a1f2054-7f06-48d7-b4cf-e6ce1c0539a8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:04.983246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0a1f2054-7f06-48d7-b4cf-e6ce1c0539a8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.080884 Jan 27 16:11:04.983914 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 544/1086] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:04 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:05.995233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ecd1e149-cd9d-46b7-a7d2-d3cb7e6aba0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:05.996147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ecd1e149-cd9d-46b7-a7d2-d3cb7e6aba0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:06.002949 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd1e149-cd9d-46b7-a7d2-d3cb7e6aba0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:06.003438 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd1e149-cd9d-46b7-a7d2-d3cb7e6aba0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:06.004469 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd1e149-cd9d-46b7-a7d2-d3cb7e6aba0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:06.004947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd1e149-cd9d-46b7-a7d2-d3cb7e6aba0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:06.088304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ecd1e149-cd9d-46b7-a7d2-d3cb7e6aba0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.097612 Jan 27 16:11:06.091373 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 543/1087] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:05 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:07.099682 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3108eb40-add6-4ce3-b694-bebc9187c7e6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:07.100672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3108eb40-add6-4ce3-b694-bebc9187c7e6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:07.107891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3108eb40-add6-4ce3-b694-bebc9187c7e6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:07.108342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3108eb40-add6-4ce3-b694-bebc9187c7e6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:07.109176 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3108eb40-add6-4ce3-b694-bebc9187c7e6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:07.109569 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3108eb40-add6-4ce3-b694-bebc9187c7e6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:07.188168 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3108eb40-add6-4ce3-b694-bebc9187c7e6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.092298 Jan 27 16:11:07.188879 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 545/1088] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:07 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:08.199785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e13fb494-8327-4afb-987e-2ea41637fa9b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:08.200815 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e13fb494-8327-4afb-987e-2ea41637fa9b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:08.207794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e13fb494-8327-4afb-987e-2ea41637fa9b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:08.208254 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e13fb494-8327-4afb-987e-2ea41637fa9b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:08.209034 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e13fb494-8327-4afb-987e-2ea41637fa9b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:08.209473 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e13fb494-8327-4afb-987e-2ea41637fa9b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:08.274636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e13fb494-8327-4afb-987e-2ea41637fa9b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.078743 Jan 27 16:11:08.275303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 544/1089] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:08 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:09.285960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5bd0d919-c170-4297-8903-cdf9570c46cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:09.286952 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5bd0d919-c170-4297-8903-cdf9570c46cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:09.294251 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bd0d919-c170-4297-8903-cdf9570c46cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:09.294699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bd0d919-c170-4297-8903-cdf9570c46cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:09.295516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bd0d919-c170-4297-8903-cdf9570c46cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:09.295952 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5bd0d919-c170-4297-8903-cdf9570c46cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:09.353186 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5bd0d919-c170-4297-8903-cdf9570c46cf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.071054 Jan 27 16:11:09.353817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 546/1090] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:09 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:10.365169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-11d6d4b3-46b0-4258-bcab-82beeae91f58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:10.366668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-11d6d4b3-46b0-4258-bcab-82beeae91f58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:10.373487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-11d6d4b3-46b0-4258-bcab-82beeae91f58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:10.373928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-11d6d4b3-46b0-4258-bcab-82beeae91f58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:10.374707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-11d6d4b3-46b0-4258-bcab-82beeae91f58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:10.375172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-11d6d4b3-46b0-4258-bcab-82beeae91f58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:10.434422 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-11d6d4b3-46b0-4258-bcab-82beeae91f58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.073155 Jan 27 16:11:10.435076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 545/1091] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:10 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:11.446281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-82ddc3f2-26eb-4276-8df8-0eed7fbda822 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:11.447318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-82ddc3f2-26eb-4276-8df8-0eed7fbda822 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:11.454045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-82ddc3f2-26eb-4276-8df8-0eed7fbda822 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:11.454487 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-82ddc3f2-26eb-4276-8df8-0eed7fbda822 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:11.455283 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-82ddc3f2-26eb-4276-8df8-0eed7fbda822 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:11.455713 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-82ddc3f2-26eb-4276-8df8-0eed7fbda822 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:11.520688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-82ddc3f2-26eb-4276-8df8-0eed7fbda822 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.078791 Jan 27 16:11:11.521349 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 547/1092] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:11 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:12.532740 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-20907374-57bb-4695-a8ec-4a7cd1202477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:12.533736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-20907374-57bb-4695-a8ec-4a7cd1202477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:12.540784 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20907374-57bb-4695-a8ec-4a7cd1202477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:12.541234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20907374-57bb-4695-a8ec-4a7cd1202477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:12.542025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20907374-57bb-4695-a8ec-4a7cd1202477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:12.542466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-20907374-57bb-4695-a8ec-4a7cd1202477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:12.609167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-20907374-57bb-4695-a8ec-4a7cd1202477 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 14 microversion: 2.20 time: 0.080339 Jan 27 16:11:12.609797 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 546/1093] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:12 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:13.620908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-69b4994c-7168-4f62-9fde-06e37ff95d0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:13.621941 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-69b4994c-7168-4f62-9fde-06e37ff95d0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:13.629026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-69b4994c-7168-4f62-9fde-06e37ff95d0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:13.629473 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-69b4994c-7168-4f62-9fde-06e37ff95d0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:13.630262 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-69b4994c-7168-4f62-9fde-06e37ff95d0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:13.630726 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-69b4994c-7168-4f62-9fde-06e37ff95d0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:13.708417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-69b4994c-7168-4f62-9fde-06e37ff95d0a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 7937 microversion: 2.20 time: 0.091395 Jan 27 16:11:13.709051 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 548/1094] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:13 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 7937 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:11:14.720752 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ff7c0289-0a85-4c54-b965-be0bcedaed63 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:14.721756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ff7c0289-0a85-4c54-b965-be0bcedaed63 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:14.729365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff7c0289-0a85-4c54-b965-be0bcedaed63 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:14.729817 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff7c0289-0a85-4c54-b965-be0bcedaed63 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:14.730605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff7c0289-0a85-4c54-b965-be0bcedaed63 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:14.731399 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ff7c0289-0a85-4c54-b965-be0bcedaed63 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:14.799652 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ff7c0289-0a85-4c54-b965-be0bcedaed63 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 15753 microversion: 2.20 time: 0.082778 Jan 27 16:11:14.800321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 547/1095] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:14 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 15753 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:15.810532 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-685d40c0-42a1-4818-8953-b5f08609a3a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:15.811577 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-685d40c0-42a1-4818-8953-b5f08609a3a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:15.819126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-685d40c0-42a1-4818-8953-b5f08609a3a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:15.819751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-685d40c0-42a1-4818-8953-b5f08609a3a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:15.820663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-685d40c0-42a1-4818-8953-b5f08609a3a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:15.821273 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-685d40c0-42a1-4818-8953-b5f08609a3a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:15.898777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-685d40c0-42a1-4818-8953-b5f08609a3a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 18608 microversion: 2.20 time: 0.092101 Jan 27 16:11:15.899456 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 549/1096] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:15 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 18608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:16.911568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c1db0091-28b3-49c7-92db-5921ba3ca925 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:16.912567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c1db0091-28b3-49c7-92db-5921ba3ca925 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:16.920138 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1db0091-28b3-49c7-92db-5921ba3ca925 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:16.920581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1db0091-28b3-49c7-92db-5921ba3ca925 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:16.921359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1db0091-28b3-49c7-92db-5921ba3ca925 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:16.921788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1db0091-28b3-49c7-92db-5921ba3ca925 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:17.004499 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c1db0091-28b3-49c7-92db-5921ba3ca925 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 20757 microversion: 2.20 time: 0.098026 Jan 27 16:11:17.005372 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 548/1097] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:16 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 20757 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:18.017128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ba5f4d22-ae37-4798-9414-c77ff1eb6494 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:18.018140 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ba5f4d22-ae37-4798-9414-c77ff1eb6494 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:18.026442 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba5f4d22-ae37-4798-9414-c77ff1eb6494 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:18.026888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba5f4d22-ae37-4798-9414-c77ff1eb6494 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:18.027696 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba5f4d22-ae37-4798-9414-c77ff1eb6494 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:18.028122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ba5f4d22-ae37-4798-9414-c77ff1eb6494 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:18.103925 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ba5f4d22-ae37-4798-9414-c77ff1eb6494 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 22870 microversion: 2.20 time: 0.090673 Jan 27 16:11:18.104557 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 550/1098] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:18 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 22870 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:19.116868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d2f9cdff-6744-4090-9d45-5a53df3ec48a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:19.117965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d2f9cdff-6744-4090-9d45-5a53df3ec48a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:19.125129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d2f9cdff-6744-4090-9d45-5a53df3ec48a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:19.125588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d2f9cdff-6744-4090-9d45-5a53df3ec48a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:19.126379 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d2f9cdff-6744-4090-9d45-5a53df3ec48a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:19.126823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d2f9cdff-6744-4090-9d45-5a53df3ec48a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:19.235571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d2f9cdff-6744-4090-9d45-5a53df3ec48a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 23871 microversion: 2.20 time: 0.123232 Jan 27 16:11:19.236226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 549/1099] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:19 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 23871 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:20.247859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-002942b7-d516-40a7-8ec7-7cb4e11ebc60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:20.248855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-002942b7-d516-40a7-8ec7-7cb4e11ebc60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:20.255831 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-002942b7-d516-40a7-8ec7-7cb4e11ebc60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:20.256325 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-002942b7-d516-40a7-8ec7-7cb4e11ebc60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:20.257103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-002942b7-d516-40a7-8ec7-7cb4e11ebc60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:20.257540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-002942b7-d516-40a7-8ec7-7cb4e11ebc60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:20.329446 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-002942b7-d516-40a7-8ec7-7cb4e11ebc60 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 25575 microversion: 2.20 time: 0.085349 Jan 27 16:11:20.330002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 551/1100] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:20 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 25575 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:21.341675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1a2a1edb-cda1-4e03-846d-780b36993fea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:21.342691 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1a2a1edb-cda1-4e03-846d-780b36993fea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:21.350720 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a2a1edb-cda1-4e03-846d-780b36993fea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:21.351218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a2a1edb-cda1-4e03-846d-780b36993fea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:21.352012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a2a1edb-cda1-4e03-846d-780b36993fea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:21.352453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1a2a1edb-cda1-4e03-846d-780b36993fea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:21.442057 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1a2a1edb-cda1-4e03-846d-780b36993fea tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 26830 microversion: 2.20 time: 0.104356 Jan 27 16:11:21.442708 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 550/1101] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:21 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 26830 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:22.454247 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c5775b45-ade7-4ce3-b8df-320e9df32d2e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:22.455529 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c5775b45-ade7-4ce3-b8df-320e9df32d2e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:22.463137 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5775b45-ade7-4ce3-b8df-320e9df32d2e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:22.463589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5775b45-ade7-4ce3-b8df-320e9df32d2e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:22.464385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5775b45-ade7-4ce3-b8df-320e9df32d2e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:22.464845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c5775b45-ade7-4ce3-b8df-320e9df32d2e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:22.555917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c5775b45-ade7-4ce3-b8df-320e9df32d2e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 27493 microversion: 2.20 time: 0.105544 Jan 27 16:11:22.556569 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 552/1102] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:22 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 27493 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:23.568213 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-42bf45fe-424c-40f7-a07f-782a74b839e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:23.569238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-42bf45fe-424c-40f7-a07f-782a74b839e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:23.576140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42bf45fe-424c-40f7-a07f-782a74b839e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:23.576593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42bf45fe-424c-40f7-a07f-782a74b839e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:23.577370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42bf45fe-424c-40f7-a07f-782a74b839e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:23.577810 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-42bf45fe-424c-40f7-a07f-782a74b839e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:23.675850 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-42bf45fe-424c-40f7-a07f-782a74b839e4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 27823 microversion: 2.20 time: 0.111609 Jan 27 16:11:23.676470 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 551/1103] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:23 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 27823 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:24.688716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a25e88c3-5d88-4b1e-888b-a710b7ef3a72 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:24.689699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a25e88c3-5d88-4b1e-888b-a710b7ef3a72 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:24.697256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25e88c3-5d88-4b1e-888b-a710b7ef3a72 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:24.697700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25e88c3-5d88-4b1e-888b-a710b7ef3a72 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:24.698479 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25e88c3-5d88-4b1e-888b-a710b7ef3a72 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:24.698907 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25e88c3-5d88-4b1e-888b-a710b7ef3a72 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:24.784059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a25e88c3-5d88-4b1e-888b-a710b7ef3a72 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28199 microversion: 2.20 time: 0.099199 Jan 27 16:11:24.785097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 553/1104] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:24 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:25.796415 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3fdf478a-134e-4366-978a-37c38de422aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:25.797411 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3fdf478a-134e-4366-978a-37c38de422aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:25.804924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fdf478a-134e-4366-978a-37c38de422aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:25.805375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fdf478a-134e-4366-978a-37c38de422aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:25.806150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fdf478a-134e-4366-978a-37c38de422aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:25.806582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fdf478a-134e-4366-978a-37c38de422aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:25.878904 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3fdf478a-134e-4366-978a-37c38de422aa tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.086429 Jan 27 16:11:25.879818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 552/1105] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:25 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:26.890942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2a53d851-7002-40bd-9e56-1de7c39ab6b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:26.891958 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2a53d851-7002-40bd-9e56-1de7c39ab6b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:26.900261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a53d851-7002-40bd-9e56-1de7c39ab6b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:26.900741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a53d851-7002-40bd-9e56-1de7c39ab6b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:26.901525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a53d851-7002-40bd-9e56-1de7c39ab6b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:26.902595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a53d851-7002-40bd-9e56-1de7c39ab6b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:26.972150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2a53d851-7002-40bd-9e56-1de7c39ab6b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.085201 Jan 27 16:11:26.972785 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 554/1106] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:26 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:27.985137 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6ae68f29-32d5-4d74-85db-229fa963f84e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:27.986061 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6ae68f29-32d5-4d74-85db-229fa963f84e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:27.993512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ae68f29-32d5-4d74-85db-229fa963f84e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:27.993971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ae68f29-32d5-4d74-85db-229fa963f84e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:27.994770 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ae68f29-32d5-4d74-85db-229fa963f84e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:27.995236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ae68f29-32d5-4d74-85db-229fa963f84e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:28.056745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6ae68f29-32d5-4d74-85db-229fa963f84e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.075561 Jan 27 16:11:28.057392 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 553/1107] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:27 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:29.069619 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2c66d5b2-b229-4b5c-a652-87b5033a90e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:29.070642 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2c66d5b2-b229-4b5c-a652-87b5033a90e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:29.077465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c66d5b2-b229-4b5c-a652-87b5033a90e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:29.077912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c66d5b2-b229-4b5c-a652-87b5033a90e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:29.078697 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c66d5b2-b229-4b5c-a652-87b5033a90e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:29.079171 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c66d5b2-b229-4b5c-a652-87b5033a90e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:29.139659 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2c66d5b2-b229-4b5c-a652-87b5033a90e7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.074537 Jan 27 16:11:29.140285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 555/1108] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:29 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:30.152668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-30c9fd3b-9734-4e1c-a606-9b41f52da051 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:30.153840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-30c9fd3b-9734-4e1c-a606-9b41f52da051 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:30.160744 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30c9fd3b-9734-4e1c-a606-9b41f52da051 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:30.161188 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30c9fd3b-9734-4e1c-a606-9b41f52da051 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:30.161961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30c9fd3b-9734-4e1c-a606-9b41f52da051 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:30.162396 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-30c9fd3b-9734-4e1c-a606-9b41f52da051 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:30.221579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-30c9fd3b-9734-4e1c-a606-9b41f52da051 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.072912 Jan 27 16:11:30.222217 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 554/1109] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:30 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:31.233865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1d23de6c-8d5b-4812-83d4-af37f81f1f0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:31.234857 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1d23de6c-8d5b-4812-83d4-af37f81f1f0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:31.242229 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d23de6c-8d5b-4812-83d4-af37f81f1f0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:31.242690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d23de6c-8d5b-4812-83d4-af37f81f1f0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:31.243483 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d23de6c-8d5b-4812-83d4-af37f81f1f0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:31.244265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1d23de6c-8d5b-4812-83d4-af37f81f1f0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:31.307931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1d23de6c-8d5b-4812-83d4-af37f81f1f0f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.078234 Jan 27 16:11:31.308564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 556/1110] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:31 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:31.914717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-986b41d0-798f-4aa6-b26a-30b9c8ecca0f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:31.915755 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-986b41d0-798f-4aa6-b26a-30b9c8ecca0f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:31.922673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-986b41d0-798f-4aa6-b26a-30b9c8ecca0f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:31.923246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-986b41d0-798f-4aa6-b26a-30b9c8ecca0f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:31.924628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-986b41d0-798f-4aa6-b26a-30b9c8ecca0f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:31.925413 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-986b41d0-798f-4aa6-b26a-30b9c8ecca0f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:31.959028 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-986b41d0-798f-4aa6-b26a-30b9c8ecca0f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048851 Jan 27 16:11:31.960131 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 555/1111] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:11:31 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:32.015179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:32.015771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:32.023045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:32.023500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:32.024275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:32.024709 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:32.049456 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:11:32.121866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-33f8a5a6-daa6-44b8-b887-5e78ffa7420e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 204 len: 0 microversion: 2.1 time: 0.110459 Jan 27 16:11:32.122341 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 557/1112] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:11:32 2022] DELETE /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:11:32.130630 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:32.131270 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:32.138596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:32.139100 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:32.139879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:32.140317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:32.273533 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:32.280868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3a7129d4-93bd-4d71-aefe-1ae4225874e4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1673 microversion: 2.1 time: 0.153867 Jan 27 16:11:32.281419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 556/1113] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:32 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:32.320559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9e93ff9d-c57b-4088-919d-ea569b2846fb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:32.321554 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9e93ff9d-c57b-4088-919d-ea569b2846fb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:32.327716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e93ff9d-c57b-4088-919d-ea569b2846fb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:32.328165 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e93ff9d-c57b-4088-919d-ea569b2846fb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:32.328938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e93ff9d-c57b-4088-919d-ea569b2846fb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:32.329370 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9e93ff9d-c57b-4088-919d-ea569b2846fb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:32.402363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9e93ff9d-c57b-4088-919d-ea569b2846fb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.086135 Jan 27 16:11:32.402949 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 558/1114] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:32 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:33.297912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:33.298540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:33.305564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:33.306020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:33.306801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:33.307273 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:33.414534 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f0f07f18-4ba5-4c35-b5d8-196a6b1219f1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:33.415578 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f0f07f18-4ba5-4c35-b5d8-196a6b1219f1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:33.422367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f0f07f18-4ba5-4c35-b5d8-196a6b1219f1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:33.422821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f0f07f18-4ba5-4c35-b5d8-196a6b1219f1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:33.423644 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f0f07f18-4ba5-4c35-b5d8-196a6b1219f1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:33.424077 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f0f07f18-4ba5-4c35-b5d8-196a6b1219f1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:33.434462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:33.441731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-90f86a0b-6a90-42a7-9421-72a7a212c94e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1673 microversion: 2.1 time: 0.147446 Jan 27 16:11:33.442298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 557/1115] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:33 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:33.485771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f0f07f18-4ba5-4c35-b5d8-196a6b1219f1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.075560 Jan 27 16:11:33.490153 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 559/1116] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:33 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:34.306306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-42a1c13d-9d05-4fbe-9aab-a084c37291cb req-da05afb5-258b-41c6-90d6-d587d7e79327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3d80d1-f3b7-4435-853e-6c267367f0f9", "name": "network-vif-deleted", "tag": "d2fdd9de-12ca-4356-8752-d36ccf10679b"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:34.310953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:11:34.310953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:11:34.319423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-42a1c13d-9d05-4fbe-9aab-a084c37291cb req-da05afb5-258b-41c6-90d6-d587d7e79327 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:34.320020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-42a1c13d-9d05-4fbe-9aab-a084c37291cb req-da05afb5-258b-41c6-90d6-d587d7e79327 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:34.331737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-42a1c13d-9d05-4fbe-9aab-a084c37291cb req-da05afb5-258b-41c6-90d6-d587d7e79327 service nova] Creating event network-vif-deleted:d2fdd9de-12ca-4356-8752-d36ccf10679b for instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 on hv-cinder-82635 Jan 27 16:11:34.337305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-42a1c13d-9d05-4fbe-9aab-a084c37291cb req-da05afb5-258b-41c6-90d6-d587d7e79327 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035166 Jan 27 16:11:34.338594 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 558/1117] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:11:34.461185 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:34.461947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:34.470552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:34.471392 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:34.472211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:34.472656 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:34.498450 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1bbf7570-15c7-43f4-9711-a8fc1189b05d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:34.500317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1bbf7570-15c7-43f4-9711-a8fc1189b05d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:34.508436 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1bbf7570-15c7-43f4-9711-a8fc1189b05d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:34.509177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1bbf7570-15c7-43f4-9711-a8fc1189b05d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:34.510201 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1bbf7570-15c7-43f4-9711-a8fc1189b05d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:34.510833 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1bbf7570-15c7-43f4-9711-a8fc1189b05d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:34.512882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:34.513337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:34.513790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lazy-loading 'fault' on Instance uuid 3f3d80d1-f3b7-4435-853e-6c267367f0f9 {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:11:34.558713 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:34.566953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3c418d77-843f-41ac-bd8b-5a1057f85ea1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 200 len: 1327 microversion: 2.1 time: 0.111691 Jan 27 16:11:34.567625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 560/1118] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:34 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:34.580875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1bbf7570-15c7-43f4-9711-a8fc1189b05d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.086552 Jan 27 16:11:34.581522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 559/1119] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:34 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:35.583704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:35.584963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:35.591322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:35.591717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:35.592496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:35.592935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:35.593057 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fd2546c7-a689-488c-83ce-942318962392 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:35.593951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fd2546c7-a689-488c-83ce-942318962392 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:35.600848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd2546c7-a689-488c-83ce-942318962392 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:35.601303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd2546c7-a689-488c-83ce-942318962392 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:35.602095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd2546c7-a689-488c-83ce-942318962392 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:35.602541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd2546c7-a689-488c-83ce-942318962392 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:35.606472 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] HTTP exception thrown: Instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 could not be found. Jan 27 16:11:35.607085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Returning 404 to user: Instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:11:35.607911 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-25196925-5863-41b9-be45-f8ed396fe948 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 404 len: 111 microversion: 2.1 time: 0.027934 Jan 27 16:11:35.608441 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 561/1120] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:35 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:11:35.616314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c0e83141-09f7-47a7-9cd9-d5b7c947fcb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '.version_select at 0x7f7817535310>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:35.636705 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c0e83141-09f7-47a7-9cd9-d5b7c947fcb4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971212329" status: 202 len: 0 microversion: 2.1 time: 0.023824 Jan 27 16:11:35.637450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 562/1121] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Jan 27 16:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971212329 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:35.663408 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fd2546c7-a689-488c-83ce-942318962392 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.074274 Jan 27 16:11:35.667531 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 560/1122] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:35 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:36.309305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-66fb1cdc-bf60-4676-95b3-9d9a87de4249 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'create', calling method: .version_select at 0x7f78129d7310>, body: {"keypair": {"name": "tempest-keypair-323975625"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:36.323286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-66fb1cdc-bf60-4676-95b3-9d9a87de4249 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:11:36.327002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-66fb1cdc-bf60-4676-95b3-9d9a87de4249 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for user 94ac7389bd7d48c7bdd305cb27558952 and project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:11:36.401044 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-66fb1cdc-bf60-4676-95b3-9d9a87de4249 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:11:36.404599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-66fb1cdc-bf60-4676-95b3-9d9a87de4249 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for user 94ac7389bd7d48c7bdd305cb27558952 and project b245b789104749da9a1417bab1c186c6. Resources: {'key_pairs'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:11:36.417380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-66fb1cdc-bf60-4676-95b3-9d9a87de4249 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.112202 Jan 27 16:11:36.417972 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 563/1123] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Jan 27 16:11:36 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:36.676584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-862a7fa4-9828-4b5c-b6fe-93f7112b4027 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:36.677616 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-862a7fa4-9828-4b5c-b6fe-93f7112b4027 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:36.684582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-862a7fa4-9828-4b5c-b6fe-93f7112b4027 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:36.685252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-862a7fa4-9828-4b5c-b6fe-93f7112b4027 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:36.686091 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-862a7fa4-9828-4b5c-b6fe-93f7112b4027 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:36.686530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-862a7fa4-9828-4b5c-b6fe-93f7112b4027 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:36.746829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-862a7fa4-9828-4b5c-b6fe-93f7112b4027 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.074337 Jan 27 16:11:36.747521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 561/1124] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:36 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:37.675630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-363996000", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bebbf3bc-5a24-4217-8b9c-919f8a6115ca"}], "security_groups": [{"name": "tempest-securitygroup--1311241140"}], "key_name": "tempest-keypair-323975625", "user_data": "}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:37.759324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e6d18812-2d0e-4723-b6df-b9e15c59f979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:37.760380 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e6d18812-2d0e-4723-b6df-b9e15c59f979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:37.767165 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6d18812-2d0e-4723-b6df-b9e15c59f979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:37.767622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6d18812-2d0e-4723-b6df-b9e15c59f979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:37.768413 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6d18812-2d0e-4723-b6df-b9e15c59f979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:37.768848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6d18812-2d0e-4723-b6df-b9e15c59f979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:37.773775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] validate_networks() for [('bebbf3bc-5a24-4217-8b9c-919f8a6115ca', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:11:37.834774 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e6d18812-2d0e-4723-b6df-b9e15c59f979 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.079265 Jan 27 16:11:37.836219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 562/1125] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:37 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:38.131480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:11:38.131902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:11:38.132370 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:11:38.132777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:11:38.133181 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:11:38.141549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:38.141995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:38.142799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:38.143261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:38.158500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for project b245b789104749da9a1417bab1c186c6. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:11:38.162407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Getting quotas for user 94ac7389bd7d48c7bdd305cb27558952 and project b245b789104749da9a1417bab1c186c6. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:11:38.173085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:11:38.175403 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:11:38.224467 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4f1159fc-711a-4190-8c21-c3e8427f1385 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.553314 Jan 27 16:11:38.225106 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 564/1126] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:11:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:11:38.235536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a15f14d4-1cac-4710-b117-6f990639896b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:38.236234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a15f14d4-1cac-4710-b117-6f990639896b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:38.291917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a15f14d4-1cac-4710-b117-6f990639896b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:38.298901 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a15f14d4-1cac-4710-b117-6f990639896b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1236 microversion: 2.1 time: 0.067303 Jan 27 16:11:38.299491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 563/1127] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:38 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:38.846268 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-04fa4995-08fe-4f28-94f3-c174feefdc8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:38.847298 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-04fa4995-08fe-4f28-94f3-c174feefdc8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:38.854221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04fa4995-08fe-4f28-94f3-c174feefdc8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:38.854929 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04fa4995-08fe-4f28-94f3-c174feefdc8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:38.855725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04fa4995-08fe-4f28-94f3-c174feefdc8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:38.856156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-04fa4995-08fe-4f28-94f3-c174feefdc8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:38.916582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-04fa4995-08fe-4f28-94f3-c174feefdc8c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28201 microversion: 2.20 time: 0.074273 Jan 27 16:11:38.917192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 565/1128] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:38 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28201 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:39.316336 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:39.317021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:39.324199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:39.324725 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:39.325599 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:39.326114 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:39.404993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:39.412249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-be29c1e5-0086-406d-a255-55589bf5bd02 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1294 microversion: 2.1 time: 0.099736 Jan 27 16:11:39.412808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 564/1129] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:39 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:39.929666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-12752ce1-96d9-44a4-b6be-8db239dc4710 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:39.930849 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-12752ce1-96d9-44a4-b6be-8db239dc4710 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:39.938073 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12752ce1-96d9-44a4-b6be-8db239dc4710 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:39.938523 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12752ce1-96d9-44a4-b6be-8db239dc4710 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:39.939365 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12752ce1-96d9-44a4-b6be-8db239dc4710 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:39.939801 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-12752ce1-96d9-44a4-b6be-8db239dc4710 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:40.019892 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-12752ce1-96d9-44a4-b6be-8db239dc4710 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28233 microversion: 2.20 time: 0.094802 Jan 27 16:11:40.021194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 566/1130] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:39 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:40.429186 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:40.430473 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:40.438394 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:40.438849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:40.439978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:40.440427 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:40.555106 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-bd29c784-9988-4aed-82ce-d5a74b9a5203 req-389599ec-bfa3-4e15-8566-cbc0c7e6b931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371f3393-3721-4edf-b044-c77a76c684fc", "tag": "ff5d25f5-ce25-4922-b228-2e1623343a70"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:40.557607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:11:40.557607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:11:40.569886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-bd29c784-9988-4aed-82ce-d5a74b9a5203 req-389599ec-bfa3-4e15-8566-cbc0c7e6b931 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:40.570329 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-bd29c784-9988-4aed-82ce-d5a74b9a5203 req-389599ec-bfa3-4e15-8566-cbc0c7e6b931 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:40.587720 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-bd29c784-9988-4aed-82ce-d5a74b9a5203 req-389599ec-bfa3-4e15-8566-cbc0c7e6b931 service nova] Creating event network-changed:ff5d25f5-ce25-4922-b228-2e1623343a70 for instance 371f3393-3721-4edf-b044-c77a76c684fc on hv-cinder-82635 Jan 27 16:11:40.597622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-bd29c784-9988-4aed-82ce-d5a74b9a5203 req-389599ec-bfa3-4e15-8566-cbc0c7e6b931 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046803 Jan 27 16:11:40.599368 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 567/1131] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:11:40.671553 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:40.679273 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cba0883a-a428-4cca-a343-bea447535d9f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.253829 Jan 27 16:11:40.680092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 565/1132] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:40 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:41.032676 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f24a9801-b0cf-4d32-9e31-d17010bc95e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:41.033628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f24a9801-b0cf-4d32-9e31-d17010bc95e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:41.040729 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f24a9801-b0cf-4d32-9e31-d17010bc95e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:41.041181 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f24a9801-b0cf-4d32-9e31-d17010bc95e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:41.041986 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f24a9801-b0cf-4d32-9e31-d17010bc95e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:41.042429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f24a9801-b0cf-4d32-9e31-d17010bc95e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:41.118842 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f24a9801-b0cf-4d32-9e31-d17010bc95e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28492 microversion: 2.20 time: 0.090310 Jan 27 16:11:41.119789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 568/1133] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:41 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28492 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:41.696651 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:41.697248 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:41.703682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:41.704136 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:41.704912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:41.705346 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:41.850684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:41.858227 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-50eee576-7349-4754-9c9b-daf3be1db2d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.165834 Jan 27 16:11:41.858789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 566/1134] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:41 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:42.130284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c4caa8db-a17e-4946-b664-2c8fdeff884c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:42.131301 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c4caa8db-a17e-4946-b664-2c8fdeff884c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:42.138124 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4caa8db-a17e-4946-b664-2c8fdeff884c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:42.138562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4caa8db-a17e-4946-b664-2c8fdeff884c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:42.139365 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4caa8db-a17e-4946-b664-2c8fdeff884c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:42.139793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c4caa8db-a17e-4946-b664-2c8fdeff884c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:42.280956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c4caa8db-a17e-4946-b664-2c8fdeff884c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.154556 Jan 27 16:11:42.281582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 569/1135] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:42 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:42.875298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:42.875950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:42.882222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:42.882672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:42.883476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:42.883913 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:43.013737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:43.020862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6eb9a8ca-7257-4ce7-8b4d-e91ce8cbaf7f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.149232 Jan 27 16:11:43.021990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 567/1136] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:42 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:43.293373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b5545ded-b1c2-4b1b-9f6d-8b0418417bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:43.294281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b5545ded-b1c2-4b1b-9f6d-8b0418417bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:43.301148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5545ded-b1c2-4b1b-9f6d-8b0418417bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:43.301601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5545ded-b1c2-4b1b-9f6d-8b0418417bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:43.302902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5545ded-b1c2-4b1b-9f6d-8b0418417bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:43.303371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5545ded-b1c2-4b1b-9f6d-8b0418417bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:43.378796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b5545ded-b1c2-4b1b-9f6d-8b0418417bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.089513 Jan 27 16:11:43.379464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 570/1137] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:43 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:44.037986 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:44.038581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:44.044950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:44.045405 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:44.046186 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:44.046626 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:44.176549 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:44.183866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-50de09f6-af78-4158-8b97-aaff8baaacdb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.150028 Jan 27 16:11:44.185936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 568/1138] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:44 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:44.391974 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bc200b4f-7d9f-46f8-9678-5940ad9f95bc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:44.392951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bc200b4f-7d9f-46f8-9678-5940ad9f95bc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:44.400261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc200b4f-7d9f-46f8-9678-5940ad9f95bc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:44.400700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc200b4f-7d9f-46f8-9678-5940ad9f95bc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:44.401462 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc200b4f-7d9f-46f8-9678-5940ad9f95bc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:44.401888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc200b4f-7d9f-46f8-9678-5940ad9f95bc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:44.469516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bc200b4f-7d9f-46f8-9678-5940ad9f95bc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.081434 Jan 27 16:11:44.470134 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 571/1139] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:44 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:45.200384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:45.200991 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:45.207317 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:45.207767 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:45.208547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:45.208983 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:45.344865 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:45.352692 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a10dc071-486b-4bbf-bf13-3b73cd744287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.155940 Jan 27 16:11:45.353178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 569/1140] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:45 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:45.481817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d51a0dc4-e2b8-4ad9-863d-ca36afdee771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:45.482841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d51a0dc4-e2b8-4ad9-863d-ca36afdee771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:45.489704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc4-e2b8-4ad9-863d-ca36afdee771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:45.490151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc4-e2b8-4ad9-863d-ca36afdee771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:45.490930 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc4-e2b8-4ad9-863d-ca36afdee771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:45.491392 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc4-e2b8-4ad9-863d-ca36afdee771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:45.614077 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d51a0dc4-e2b8-4ad9-863d-ca36afdee771 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.136353 Jan 27 16:11:45.614633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 572/1141] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:45 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:46.369974 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:46.370581 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:46.376941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:46.377397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:46.378175 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:46.378613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:46.505975 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:46.513627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1b71d91e-61c1-4b77-8368-1488060ddd39 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.147196 Jan 27 16:11:46.514297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 570/1142] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:46 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:46.626267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cda261b5-9f4f-4b66-aea9-29eda065d19c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:46.627284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cda261b5-9f4f-4b66-aea9-29eda065d19c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:46.634153 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cda261b5-9f4f-4b66-aea9-29eda065d19c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:46.634596 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cda261b5-9f4f-4b66-aea9-29eda065d19c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:46.635410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cda261b5-9f4f-4b66-aea9-29eda065d19c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:46.635839 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cda261b5-9f4f-4b66-aea9-29eda065d19c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:46.698373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cda261b5-9f4f-4b66-aea9-29eda065d19c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.075975 Jan 27 16:11:46.699036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 573/1143] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:46 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:47.284940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-4a86f284-ee6f-4dd3-a4ca-0a1bf1194531 req-1e3bdbf2-ada4-4828-a925-d7819df2e179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371f3393-3721-4edf-b044-c77a76c684fc", "name": "network-vif-plugged", "status": "completed", "tag": "ff5d25f5-ce25-4922-b228-2e1623343a70"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:47.287193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:11:47.287193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:11:47.294122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-4a86f284-ee6f-4dd3-a4ca-0a1bf1194531 req-1e3bdbf2-ada4-4828-a925-d7819df2e179 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:47.294571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-4a86f284-ee6f-4dd3-a4ca-0a1bf1194531 req-1e3bdbf2-ada4-4828-a925-d7819df2e179 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:47.305855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-4a86f284-ee6f-4dd3-a4ca-0a1bf1194531 req-1e3bdbf2-ada4-4828-a925-d7819df2e179 service nova] Creating event network-vif-plugged:ff5d25f5-ce25-4922-b228-2e1623343a70 for instance 371f3393-3721-4edf-b044-c77a76c684fc on hv-cinder-82635 Jan 27 16:11:47.310899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-4a86f284-ee6f-4dd3-a4ca-0a1bf1194531 req-1e3bdbf2-ada4-4828-a925-d7819df2e179 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029646 Jan 27 16:11:47.311525 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 571/1144] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:11:47.530227 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:47.530934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:47.537796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:47.538286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:47.539093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:47.539533 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:47.673257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:47.681038 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-703f8cd2-bf7b-4a84-aebc-8ec801156b8d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.155008 Jan 27 16:11:47.681592 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 574/1145] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:47 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:47.710678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9d80030b-3118-48d9-a2c9-8975e9d2e5bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:47.711687 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9d80030b-3118-48d9-a2c9-8975e9d2e5bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:47.717722 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d80030b-3118-48d9-a2c9-8975e9d2e5bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:47.718170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d80030b-3118-48d9-a2c9-8975e9d2e5bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:47.718942 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d80030b-3118-48d9-a2c9-8975e9d2e5bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:47.719397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9d80030b-3118-48d9-a2c9-8975e9d2e5bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:47.879647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9d80030b-3118-48d9-a2c9-8975e9d2e5bf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.173153 Jan 27 16:11:47.880927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 572/1146] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:47 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:48.697455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:48.698058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:48.704389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:48.704871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:48.705652 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:48.706085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:48.835393 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:48.843229 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a7cc1dc5-0092-4aef-9713-19f8524c34ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1362 microversion: 2.1 time: 0.149279 Jan 27 16:11:48.843802 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 575/1147] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:48 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:48.892583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bc5399c4-c294-4b1a-835f-d34e1e92249d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:48.893585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bc5399c4-c294-4b1a-835f-d34e1e92249d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:48.901560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc5399c4-c294-4b1a-835f-d34e1e92249d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:48.902013 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc5399c4-c294-4b1a-835f-d34e1e92249d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:48.902807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc5399c4-c294-4b1a-835f-d34e1e92249d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:48.903268 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc5399c4-c294-4b1a-835f-d34e1e92249d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:48.966138 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bc5399c4-c294-4b1a-835f-d34e1e92249d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.077152 Jan 27 16:11:48.966695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 573/1148] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:48 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:49.859781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:49.860381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:49.866627 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:49.867119 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:49.867901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:49.868336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:49.978187 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c1190ca6-15f4-44e4-a7a3-887e2a411b21 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:49.979531 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c1190ca6-15f4-44e4-a7a3-887e2a411b21 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:49.986240 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1190ca6-15f4-44e4-a7a3-887e2a411b21 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:49.986684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1190ca6-15f4-44e4-a7a3-887e2a411b21 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:49.987488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1190ca6-15f4-44e4-a7a3-887e2a411b21 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:49.987928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1190ca6-15f4-44e4-a7a3-887e2a411b21 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:49.998031 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:11:50.006002 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f8aad7d8-645b-434b-9329-49fa62c20bdf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1547 microversion: 2.1 time: 0.149904 Jan 27 16:11:50.006572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 576/1149] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:11:49 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:11:50.021805 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a2340473-4866-412d-acc5-99446c32b355 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:11:50.022293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a2340473-4866-412d-acc5-99446c32b355 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:50.028135 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2340473-4866-412d-acc5-99446c32b355 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:50.028601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2340473-4866-412d-acc5-99446c32b355 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:50.029366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2340473-4866-412d-acc5-99446c32b355 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:50.029803 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a2340473-4866-412d-acc5-99446c32b355 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:50.049033 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c1190ca6-15f4-44e4-a7a3-887e2a411b21 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.074718 Jan 27 16:11:50.053535 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 574/1150] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:49 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:50.106736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a2340473-4866-412d-acc5-99446c32b355 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088483 Jan 27 16:11:50.107367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 577/1151] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jan 27 16:11:50 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:11:51.041248 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d75417f7-51dd-46aa-8983-b0db88c37d9a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:51.042860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d75417f7-51dd-46aa-8983-b0db88c37d9a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:51.051522 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d75417f7-51dd-46aa-8983-b0db88c37d9a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:51.052509 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d75417f7-51dd-46aa-8983-b0db88c37d9a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:51.053309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d75417f7-51dd-46aa-8983-b0db88c37d9a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:51.053741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d75417f7-51dd-46aa-8983-b0db88c37d9a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:51.113892 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d75417f7-51dd-46aa-8983-b0db88c37d9a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.076465 Jan 27 16:11:51.115801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 575/1152] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:51 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:51.121305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f77caa16-0c21-4169-afeb-e901337d5cfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:51.122445 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f77caa16-0c21-4169-afeb-e901337d5cfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:51.129715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f77caa16-0c21-4169-afeb-e901337d5cfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:51.130238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f77caa16-0c21-4169-afeb-e901337d5cfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:51.130943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f77caa16-0c21-4169-afeb-e901337d5cfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:51.131586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f77caa16-0c21-4169-afeb-e901337d5cfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:51.168306 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-9c0a76be-d50d-43f8-be6e-ec3b78a255d5 req-863a9f9a-94ec-492e-b3f3-c501a1a2cb37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371f3393-3721-4edf-b044-c77a76c684fc", "tag": "ff5d25f5-ce25-4922-b228-2e1623343a70"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:51.170001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:11:51.170001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:11:51.177819 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-9c0a76be-d50d-43f8-be6e-ec3b78a255d5 req-863a9f9a-94ec-492e-b3f3-c501a1a2cb37 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:51.178257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-9c0a76be-d50d-43f8-be6e-ec3b78a255d5 req-863a9f9a-94ec-492e-b3f3-c501a1a2cb37 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:51.189691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-9c0a76be-d50d-43f8-be6e-ec3b78a255d5 req-863a9f9a-94ec-492e-b3f3-c501a1a2cb37 service nova] Creating event network-changed:ff5d25f5-ce25-4922-b228-2e1623343a70 for instance 371f3393-3721-4edf-b044-c77a76c684fc on hv-cinder-82635 Jan 27 16:11:51.193012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f77caa16-0c21-4169-afeb-e901337d5cfc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.075477 Jan 27 16:11:51.194703 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 576/1153] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:51 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:51.194920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-9c0a76be-d50d-43f8-be6e-ec3b78a255d5 req-863a9f9a-94ec-492e-b3f3-c501a1a2cb37 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155732 Jan 27 16:11:51.195765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 578/1154] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:11:52.126714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e9783b92-bd6d-4790-bfc2-9a858faa26fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:52.127857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e9783b92-bd6d-4790-bfc2-9a858faa26fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:52.135462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9783b92-bd6d-4790-bfc2-9a858faa26fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:52.135992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9783b92-bd6d-4790-bfc2-9a858faa26fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:52.136781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9783b92-bd6d-4790-bfc2-9a858faa26fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:52.137223 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e9783b92-bd6d-4790-bfc2-9a858faa26fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:52.195921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e9783b92-bd6d-4790-bfc2-9a858faa26fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.073680 Jan 27 16:11:52.196578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 577/1155] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:52 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:52.205325 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-344ffea5-c510-44a2-8599-2d2a998b2c06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:52.206371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-344ffea5-c510-44a2-8599-2d2a998b2c06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:52.212769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-344ffea5-c510-44a2-8599-2d2a998b2c06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:52.213222 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-344ffea5-c510-44a2-8599-2d2a998b2c06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:52.214006 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-344ffea5-c510-44a2-8599-2d2a998b2c06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:52.214447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-344ffea5-c510-44a2-8599-2d2a998b2c06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:52.275950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-344ffea5-c510-44a2-8599-2d2a998b2c06 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.074430 Jan 27 16:11:52.276840 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 579/1156] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:52 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:53.207285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-344c3951-66a3-4479-afaf-f19bdfa49319 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:53.208788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-344c3951-66a3-4479-afaf-f19bdfa49319 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:53.215560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-344c3951-66a3-4479-afaf-f19bdfa49319 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:53.215999 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-344c3951-66a3-4479-afaf-f19bdfa49319 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:53.216762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-344c3951-66a3-4479-afaf-f19bdfa49319 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:53.217222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-344c3951-66a3-4479-afaf-f19bdfa49319 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:53.275331 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-344c3951-66a3-4479-afaf-f19bdfa49319 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.071864 Jan 27 16:11:53.275932 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 578/1157] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:53 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:53.288755 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d7d7e436-2ca3-450b-8886-d51b38ae091e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:53.289759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d7d7e436-2ca3-450b-8886-d51b38ae091e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:53.296621 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7d7e436-2ca3-450b-8886-d51b38ae091e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:53.297074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7d7e436-2ca3-450b-8886-d51b38ae091e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:53.297853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7d7e436-2ca3-450b-8886-d51b38ae091e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:53.298290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d7d7e436-2ca3-450b-8886-d51b38ae091e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:53.361010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d7d7e436-2ca3-450b-8886-d51b38ae091e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.076778 Jan 27 16:11:53.361651 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 580/1158] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:53 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:11:54.287124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dbf74412-d61c-4594-9d29-780fd3beea14 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:54.288116 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dbf74412-d61c-4594-9d29-780fd3beea14 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:54.295193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf74412-d61c-4594-9d29-780fd3beea14 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:54.295649 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf74412-d61c-4594-9d29-780fd3beea14 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:54.296431 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf74412-d61c-4594-9d29-780fd3beea14 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:54.296875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dbf74412-d61c-4594-9d29-780fd3beea14 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:54.358578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dbf74412-d61c-4594-9d29-780fd3beea14 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.075897 Jan 27 16:11:54.360185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 579/1159] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:54 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:11:54.372824 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-80219a63-e227-4678-9fbf-51d4b3679b20 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:54.373847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-80219a63-e227-4678-9fbf-51d4b3679b20 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:54.380836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80219a63-e227-4678-9fbf-51d4b3679b20 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:54.381287 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80219a63-e227-4678-9fbf-51d4b3679b20 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:54.382064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80219a63-e227-4678-9fbf-51d4b3679b20 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:54.382500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-80219a63-e227-4678-9fbf-51d4b3679b20 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:54.441023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-80219a63-e227-4678-9fbf-51d4b3679b20 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.072031 Jan 27 16:11:54.442004 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 581/1160] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:54 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:55.375887 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dc9cd00b-8f5d-42c0-b6e7-81746b35ccab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:55.376982 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dc9cd00b-8f5d-42c0-b6e7-81746b35ccab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:55.384548 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc9cd00b-8f5d-42c0-b6e7-81746b35ccab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:55.385000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc9cd00b-8f5d-42c0-b6e7-81746b35ccab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:55.385792 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc9cd00b-8f5d-42c0-b6e7-81746b35ccab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:55.386228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dc9cd00b-8f5d-42c0-b6e7-81746b35ccab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:55.451623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dc9cd00b-8f5d-42c0-b6e7-81746b35ccab tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.084948 Jan 27 16:11:55.454739 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 580/1161] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:55 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:55.454882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-219c9ea2-88db-4708-8f90-2d6652e30cb6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:55.454882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-219c9ea2-88db-4708-8f90-2d6652e30cb6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:55.460355 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-219c9ea2-88db-4708-8f90-2d6652e30cb6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:55.460797 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-219c9ea2-88db-4708-8f90-2d6652e30cb6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:55.461568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-219c9ea2-88db-4708-8f90-2d6652e30cb6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:55.461995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-219c9ea2-88db-4708-8f90-2d6652e30cb6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:55.519447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-219c9ea2-88db-4708-8f90-2d6652e30cb6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.070664 Jan 27 16:11:55.520099 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 582/1162] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:55 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:56.463953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2b252fc3-9628-4f1f-b7d0-e832567fe287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:56.464983 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2b252fc3-9628-4f1f-b7d0-e832567fe287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:56.471860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2b252fc3-9628-4f1f-b7d0-e832567fe287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:56.472309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2b252fc3-9628-4f1f-b7d0-e832567fe287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:56.473609 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2b252fc3-9628-4f1f-b7d0-e832567fe287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:56.474046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2b252fc3-9628-4f1f-b7d0-e832567fe287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:56.531242 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2b252fc3-9628-4f1f-b7d0-e832567fe287 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.071903 Jan 27 16:11:56.531515 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-513e240f-990b-468f-a25b-0f01b3fa321f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:56.531981 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 581/1163] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:56 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:56.532516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-513e240f-990b-468f-a25b-0f01b3fa321f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:56.539938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-513e240f-990b-468f-a25b-0f01b3fa321f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:56.540399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-513e240f-990b-468f-a25b-0f01b3fa321f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:56.541166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-513e240f-990b-468f-a25b-0f01b3fa321f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:56.541601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-513e240f-990b-468f-a25b-0f01b3fa321f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:56.602484 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-513e240f-990b-468f-a25b-0f01b3fa321f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.074877 Jan 27 16:11:56.603155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 583/1164] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:56 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:57.542242 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6404a44e-14a8-4a81-bd9f-8158b98dec2b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:57.543204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6404a44e-14a8-4a81-bd9f-8158b98dec2b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:57.550010 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6404a44e-14a8-4a81-bd9f-8158b98dec2b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:57.550467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6404a44e-14a8-4a81-bd9f-8158b98dec2b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:57.551784 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6404a44e-14a8-4a81-bd9f-8158b98dec2b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:57.552226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6404a44e-14a8-4a81-bd9f-8158b98dec2b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:57.611131 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6404a44e-14a8-4a81-bd9f-8158b98dec2b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.072707 Jan 27 16:11:57.612371 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 582/1165] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:57 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:57.614617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2d3653e4-0ebe-4725-aae6-fb75351bee9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:57.615632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d3653e4-0ebe-4725-aae6-fb75351bee9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:57.622617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d3653e4-0ebe-4725-aae6-fb75351bee9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:57.623095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d3653e4-0ebe-4725-aae6-fb75351bee9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:57.623866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d3653e4-0ebe-4725-aae6-fb75351bee9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:57.624293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d3653e4-0ebe-4725-aae6-fb75351bee9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:57.686293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2d3653e4-0ebe-4725-aae6-fb75351bee9a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.076041 Jan 27 16:11:57.687307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 584/1166] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:57 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:58.622211 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6ebdfa2f-6b98-45a8-a5e1-1d2587614ec3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:58.623257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6ebdfa2f-6b98-45a8-a5e1-1d2587614ec3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:58.630558 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ebdfa2f-6b98-45a8-a5e1-1d2587614ec3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:58.631115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ebdfa2f-6b98-45a8-a5e1-1d2587614ec3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:58.631909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ebdfa2f-6b98-45a8-a5e1-1d2587614ec3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:58.632364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ebdfa2f-6b98-45a8-a5e1-1d2587614ec3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:58.692348 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6ebdfa2f-6b98-45a8-a5e1-1d2587614ec3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.073454 Jan 27 16:11:58.693402 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 583/1167] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:58 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:58.698631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-020f4fc8-6c24-4ae3-a9e4-b321632f7c40 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:58.699656 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-020f4fc8-6c24-4ae3-a9e4-b321632f7c40 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:58.707735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-020f4fc8-6c24-4ae3-a9e4-b321632f7c40 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:58.708196 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-020f4fc8-6c24-4ae3-a9e4-b321632f7c40 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:58.708979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-020f4fc8-6c24-4ae3-a9e4-b321632f7c40 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:58.709405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-020f4fc8-6c24-4ae3-a9e4-b321632f7c40 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:58.780069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-020f4fc8-6c24-4ae3-a9e4-b321632f7c40 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.085206 Jan 27 16:11:58.783882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 585/1168] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:58 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:11:59.703948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-395c00b8-e397-466c-a140-861994ea3364 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:59.704953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-395c00b8-e397-466c-a140-861994ea3364 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:59.712356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-395c00b8-e397-466c-a140-861994ea3364 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:59.712800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-395c00b8-e397-466c-a140-861994ea3364 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:59.713571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-395c00b8-e397-466c-a140-861994ea3364 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:59.713999 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-395c00b8-e397-466c-a140-861994ea3364 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:59.775337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-395c00b8-e397-466c-a140-861994ea3364 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.075254 Jan 27 16:11:59.775984 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 584/1169] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:11:59 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:11:59.792118 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-878766e3-cdc9-47e7-a32a-2fa0877ce0df tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:11:59.793213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-878766e3-cdc9-47e7-a32a-2fa0877ce0df tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:11:59.800301 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-878766e3-cdc9-47e7-a32a-2fa0877ce0df tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:59.800755 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-878766e3-cdc9-47e7-a32a-2fa0877ce0df tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:59.801543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-878766e3-cdc9-47e7-a32a-2fa0877ce0df tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:11:59.801981 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-878766e3-cdc9-47e7-a32a-2fa0877ce0df tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:11:59.865178 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-878766e3-cdc9-47e7-a32a-2fa0877ce0df tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.076966 Jan 27 16:11:59.865826 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 586/1170] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:11:59 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:00.787364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-55693a04-77c6-4c59-ac1b-2970930cffa4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:00.788364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-55693a04-77c6-4c59-ac1b-2970930cffa4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:00.800010 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55693a04-77c6-4c59-ac1b-2970930cffa4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:00.802272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55693a04-77c6-4c59-ac1b-2970930cffa4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:00.802272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55693a04-77c6-4c59-ac1b-2970930cffa4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:00.802589 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-55693a04-77c6-4c59-ac1b-2970930cffa4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:00.868688 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-55693a04-77c6-4c59-ac1b-2970930cffa4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 14 microversion: 2.1 time: 0.085846 Jan 27 16:12:00.869330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 585/1171] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:00 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:12:00.877150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-70c85ef8-8bab-42b2-ad19-da9be067d410 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:00.878186 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-70c85ef8-8bab-42b2-ad19-da9be067d410 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:00.885147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c85ef8-8bab-42b2-ad19-da9be067d410 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:00.885595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c85ef8-8bab-42b2-ad19-da9be067d410 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:00.886379 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c85ef8-8bab-42b2-ad19-da9be067d410 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:00.886823 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c85ef8-8bab-42b2-ad19-da9be067d410 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:00.947837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-70c85ef8-8bab-42b2-ad19-da9be067d410 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.074483 Jan 27 16:12:00.948487 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 587/1172] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:00 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:01.880571 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ac3a28f6-b56b-45e0-80d6-a1c0a4e363d8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:01.881559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ac3a28f6-b56b-45e0-80d6-a1c0a4e363d8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:01.888273 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac3a28f6-b56b-45e0-80d6-a1c0a4e363d8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:01.888715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac3a28f6-b56b-45e0-80d6-a1c0a4e363d8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:01.889483 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac3a28f6-b56b-45e0-80d6-a1c0a4e363d8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:01.889908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ac3a28f6-b56b-45e0-80d6-a1c0a4e363d8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:01.959493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4b5dd413-45c2-4e65-b0dc-dcefc48476a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:01.960520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4b5dd413-45c2-4e65-b0dc-dcefc48476a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:01.966247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ac3a28f6-b56b-45e0-80d6-a1c0a4e363d8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 9709 microversion: 2.1 time: 0.090050 Jan 27 16:12:01.969681 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 586/1173] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:01 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 9709 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:01.969837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b5dd413-45c2-4e65-b0dc-dcefc48476a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:01.969837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b5dd413-45c2-4e65-b0dc-dcefc48476a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:01.969837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b5dd413-45c2-4e65-b0dc-dcefc48476a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:01.969837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b5dd413-45c2-4e65-b0dc-dcefc48476a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:02.038813 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4b5dd413-45c2-4e65-b0dc-dcefc48476a0 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.083244 Jan 27 16:12:02.039477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 588/1174] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:01 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:02.978558 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-efcf2a0a-54b0-47a9-81f0-4fb0de7eb19b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:02.979591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-efcf2a0a-54b0-47a9-81f0-4fb0de7eb19b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:02.986507 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efcf2a0a-54b0-47a9-81f0-4fb0de7eb19b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:02.986954 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efcf2a0a-54b0-47a9-81f0-4fb0de7eb19b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:02.987758 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efcf2a0a-54b0-47a9-81f0-4fb0de7eb19b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:02.988248 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-efcf2a0a-54b0-47a9-81f0-4fb0de7eb19b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:03.050898 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-974f4ad8-1850-4168-a4b7-63eff4726616 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:03.051921 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-974f4ad8-1850-4168-a4b7-63eff4726616 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:03.058945 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974f4ad8-1850-4168-a4b7-63eff4726616 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:03.059876 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974f4ad8-1850-4168-a4b7-63eff4726616 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:03.060291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-efcf2a0a-54b0-47a9-81f0-4fb0de7eb19b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 16721 microversion: 2.1 time: 0.085829 Jan 27 16:12:03.060687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974f4ad8-1850-4168-a4b7-63eff4726616 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:03.061147 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 587/1175] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:02 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 16721 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:03.061274 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974f4ad8-1850-4168-a4b7-63eff4726616 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:03.137951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-974f4ad8-1850-4168-a4b7-63eff4726616 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.090987 Jan 27 16:12:03.138584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 589/1176] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:03 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:04.072289 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-00294a0f-e6f8-49fe-a8c3-173ba960f056 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:04.073326 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-00294a0f-e6f8-49fe-a8c3-173ba960f056 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:04.080306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-00294a0f-e6f8-49fe-a8c3-173ba960f056 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:04.080766 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-00294a0f-e6f8-49fe-a8c3-173ba960f056 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:04.081550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-00294a0f-e6f8-49fe-a8c3-173ba960f056 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:04.081989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-00294a0f-e6f8-49fe-a8c3-173ba960f056 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:04.149877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-59a3252e-007e-465c-95f2-0d096b2dc42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:04.150858 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-59a3252e-007e-465c-95f2-0d096b2dc42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:04.153865 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-00294a0f-e6f8-49fe-a8c3-173ba960f056 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 18449 microversion: 2.1 time: 0.084859 Jan 27 16:12:04.157613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 588/1177] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:04 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 18449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:04.157915 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59a3252e-007e-465c-95f2-0d096b2dc42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:04.158362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59a3252e-007e-465c-95f2-0d096b2dc42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:04.159176 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59a3252e-007e-465c-95f2-0d096b2dc42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:04.159611 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-59a3252e-007e-465c-95f2-0d096b2dc42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:04.228069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-59a3252e-007e-465c-95f2-0d096b2dc42c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.081986 Jan 27 16:12:04.228960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 590/1178] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:04 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:05.165954 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-321bfa9b-0ee2-41d5-967b-5d9176f3fa3d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:05.166951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-321bfa9b-0ee2-41d5-967b-5d9176f3fa3d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:05.173729 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-321bfa9b-0ee2-41d5-967b-5d9176f3fa3d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:05.174208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-321bfa9b-0ee2-41d5-967b-5d9176f3fa3d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:05.175001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-321bfa9b-0ee2-41d5-967b-5d9176f3fa3d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:05.175938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-321bfa9b-0ee2-41d5-967b-5d9176f3fa3d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:05.241024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1ffade70-2e23-410b-8f3f-d3c09757d8c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:05.242147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1ffade70-2e23-410b-8f3f-d3c09757d8c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:05.247947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-321bfa9b-0ee2-41d5-967b-5d9176f3fa3d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 20991 microversion: 2.1 time: 0.085943 Jan 27 16:12:05.251618 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 589/1179] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:05 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 20991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:05.251777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ffade70-2e23-410b-8f3f-d3c09757d8c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:05.251777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ffade70-2e23-410b-8f3f-d3c09757d8c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:05.251777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ffade70-2e23-410b-8f3f-d3c09757d8c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:05.251777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ffade70-2e23-410b-8f3f-d3c09757d8c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:05.321054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1ffade70-2e23-410b-8f3f-d3c09757d8c4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.084418 Jan 27 16:12:05.321686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 591/1180] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:05 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:06.260068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fafaa89a-9446-4762-aac0-f1a1f743a282 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:06.260982 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fafaa89a-9446-4762-aac0-f1a1f743a282 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:06.267867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fafaa89a-9446-4762-aac0-f1a1f743a282 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:06.268314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fafaa89a-9446-4762-aac0-f1a1f743a282 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:06.269733 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fafaa89a-9446-4762-aac0-f1a1f743a282 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:06.270174 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fafaa89a-9446-4762-aac0-f1a1f743a282 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:06.333629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b418779b-9cf5-45d3-a691-943bb9a6c020 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:06.334629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b418779b-9cf5-45d3-a691-943bb9a6c020 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:06.341866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b418779b-9cf5-45d3-a691-943bb9a6c020 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:06.342316 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b418779b-9cf5-45d3-a691-943bb9a6c020 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:06.343141 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b418779b-9cf5-45d3-a691-943bb9a6c020 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:06.343609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b418779b-9cf5-45d3-a691-943bb9a6c020 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:06.356810 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fafaa89a-9446-4762-aac0-f1a1f743a282 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 22888 microversion: 2.1 time: 0.100718 Jan 27 16:12:06.358170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 590/1181] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:06 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 22888 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:06.407307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b418779b-9cf5-45d3-a691-943bb9a6c020 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.078225 Jan 27 16:12:06.407925 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 592/1182] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:06 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:07.369659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8a95c8b4-faa7-4ef8-a670-9c7177c27845 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:07.370653 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8a95c8b4-faa7-4ef8-a670-9c7177c27845 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:07.377532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a95c8b4-faa7-4ef8-a670-9c7177c27845 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:07.377990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a95c8b4-faa7-4ef8-a670-9c7177c27845 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:07.378929 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a95c8b4-faa7-4ef8-a670-9c7177c27845 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:07.379392 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a95c8b4-faa7-4ef8-a670-9c7177c27845 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:07.418711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ed2be335-00ff-4e7c-bdff-f9369c273e61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:07.419717 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ed2be335-00ff-4e7c-bdff-f9369c273e61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:07.426478 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ed2be335-00ff-4e7c-bdff-f9369c273e61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:07.426922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ed2be335-00ff-4e7c-bdff-f9369c273e61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:07.427711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ed2be335-00ff-4e7c-bdff-f9369c273e61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:07.428146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ed2be335-00ff-4e7c-bdff-f9369c273e61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:07.459466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8a95c8b4-faa7-4ef8-a670-9c7177c27845 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 23795 microversion: 2.1 time: 0.093732 Jan 27 16:12:07.460118 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 591/1183] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:07 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 23795 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:07.489133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ed2be335-00ff-4e7c-bdff-f9369c273e61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.074239 Jan 27 16:12:07.489751 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 593/1184] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:07 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:08.471441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f25bfe17-6a48-40cf-b859-8f209834b751 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:08.472990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f25bfe17-6a48-40cf-b859-8f209834b751 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:08.480380 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f25bfe17-6a48-40cf-b859-8f209834b751 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:08.480830 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f25bfe17-6a48-40cf-b859-8f209834b751 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:08.481625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f25bfe17-6a48-40cf-b859-8f209834b751 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:08.482065 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f25bfe17-6a48-40cf-b859-8f209834b751 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:08.500308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-974bc1f1-49f6-4250-802a-5b3c4bc0ddc2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:08.501383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-974bc1f1-49f6-4250-802a-5b3c4bc0ddc2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:08.508367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974bc1f1-49f6-4250-802a-5b3c4bc0ddc2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:08.508811 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974bc1f1-49f6-4250-802a-5b3c4bc0ddc2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:08.510342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974bc1f1-49f6-4250-802a-5b3c4bc0ddc2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:08.510774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-974bc1f1-49f6-4250-802a-5b3c4bc0ddc2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:08.564923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f25bfe17-6a48-40cf-b859-8f209834b751 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 25159 microversion: 2.1 time: 0.097406 Jan 27 16:12:08.565576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 592/1185] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:08 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 25159 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:08.595711 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-974bc1f1-49f6-4250-802a-5b3c4bc0ddc2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.099134 Jan 27 16:12:08.596307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 594/1186] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:08 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:09.577591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d1dfa4f5-f600-4abe-8ea4-7b4227b53847 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:09.578600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d1dfa4f5-f600-4abe-8ea4-7b4227b53847 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:09.585842 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d1dfa4f5-f600-4abe-8ea4-7b4227b53847 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:09.586296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d1dfa4f5-f600-4abe-8ea4-7b4227b53847 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:09.587122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d1dfa4f5-f600-4abe-8ea4-7b4227b53847 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:09.587565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d1dfa4f5-f600-4abe-8ea4-7b4227b53847 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:09.608976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f72d6ddc-619e-4310-8052-39b279e88eb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:09.610030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f72d6ddc-619e-4310-8052-39b279e88eb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:09.617628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f72d6ddc-619e-4310-8052-39b279e88eb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:09.618084 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f72d6ddc-619e-4310-8052-39b279e88eb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:09.618876 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f72d6ddc-619e-4310-8052-39b279e88eb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:09.619342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f72d6ddc-619e-4310-8052-39b279e88eb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:09.666148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d1dfa4f5-f600-4abe-8ea4-7b4227b53847 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 26648 microversion: 2.1 time: 0.092517 Jan 27 16:12:09.667127 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 593/1187] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:09 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 26648 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:09.700075 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f72d6ddc-619e-4310-8052-39b279e88eb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.095288 Jan 27 16:12:09.700709 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 595/1188] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:09 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:10.679299 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8698ec1c-d3cd-4aee-b0b0-82d5d08964fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:10.680305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8698ec1c-d3cd-4aee-b0b0-82d5d08964fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:10.687218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8698ec1c-d3cd-4aee-b0b0-82d5d08964fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:10.687669 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8698ec1c-d3cd-4aee-b0b0-82d5d08964fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:10.688458 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8698ec1c-d3cd-4aee-b0b0-82d5d08964fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:10.688897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8698ec1c-d3cd-4aee-b0b0-82d5d08964fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:10.713065 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1206697b-735e-4f0b-8b6d-d88b9a7f149c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:10.714047 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1206697b-735e-4f0b-8b6d-d88b9a7f149c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:10.722399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1206697b-735e-4f0b-8b6d-d88b9a7f149c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:10.722837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1206697b-735e-4f0b-8b6d-d88b9a7f149c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:10.723646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1206697b-735e-4f0b-8b6d-d88b9a7f149c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:10.724078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1206697b-735e-4f0b-8b6d-d88b9a7f149c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:10.773869 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8698ec1c-d3cd-4aee-b0b0-82d5d08964fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 27640 microversion: 2.1 time: 0.098822 Jan 27 16:12:10.774564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 594/1189] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:10 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 27640 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:10.812180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1206697b-735e-4f0b-8b6d-d88b9a7f149c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.102936 Jan 27 16:12:10.812857 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 596/1190] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:10 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:11.786009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0b77192c-7d4b-48c6-8100-b12f44d57960 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:11.787066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0b77192c-7d4b-48c6-8100-b12f44d57960 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:11.793971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b77192c-7d4b-48c6-8100-b12f44d57960 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:11.794421 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b77192c-7d4b-48c6-8100-b12f44d57960 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:11.795258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b77192c-7d4b-48c6-8100-b12f44d57960 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:11.795693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b77192c-7d4b-48c6-8100-b12f44d57960 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:11.825686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8f3e146b-21a4-4e0c-9dcb-adb7f2d0faf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:11.826891 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8f3e146b-21a4-4e0c-9dcb-adb7f2d0faf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:11.834415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f3e146b-21a4-4e0c-9dcb-adb7f2d0faf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:11.834863 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f3e146b-21a4-4e0c-9dcb-adb7f2d0faf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:11.835874 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f3e146b-21a4-4e0c-9dcb-adb7f2d0faf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:11.836317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8f3e146b-21a4-4e0c-9dcb-adb7f2d0faf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:11.883230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0b77192c-7d4b-48c6-8100-b12f44d57960 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 27870 microversion: 2.1 time: 0.101649 Jan 27 16:12:11.883888 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 595/1191] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:11 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 27870 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:11.913735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8f3e146b-21a4-4e0c-9dcb-adb7f2d0faf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.092636 Jan 27 16:12:11.917684 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 597/1192] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:11 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:12.894858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-206e9ad3-5d23-41a4-a388-6c3b9c5ed719 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:12.895917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-206e9ad3-5d23-41a4-a388-6c3b9c5ed719 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:12.902875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-206e9ad3-5d23-41a4-a388-6c3b9c5ed719 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:12.903423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-206e9ad3-5d23-41a4-a388-6c3b9c5ed719 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:12.904209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-206e9ad3-5d23-41a4-a388-6c3b9c5ed719 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:12.904646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-206e9ad3-5d23-41a4-a388-6c3b9c5ed719 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:12.925820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3bb91eac-b96e-48ba-a75f-1d782d07887b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:12.926817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3bb91eac-b96e-48ba-a75f-1d782d07887b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:12.933756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3bb91eac-b96e-48ba-a75f-1d782d07887b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:12.934205 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3bb91eac-b96e-48ba-a75f-1d782d07887b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:12.935015 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3bb91eac-b96e-48ba-a75f-1d782d07887b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:12.935455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3bb91eac-b96e-48ba-a75f-1d782d07887b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:13.004736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-206e9ad3-5d23-41a4-a388-6c3b9c5ed719 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.113800 Jan 27 16:12:13.005639 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 596/1193] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:12 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:13.024745 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3bb91eac-b96e-48ba-a75f-1d782d07887b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.103352 Jan 27 16:12:13.026025 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 598/1194] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:12 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:14.017060 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-700f5a07-f8da-4802-b33f-4b47f3504a5b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:14.018064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-700f5a07-f8da-4802-b33f-4b47f3504a5b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:14.024958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-700f5a07-f8da-4802-b33f-4b47f3504a5b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:14.025413 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-700f5a07-f8da-4802-b33f-4b47f3504a5b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:14.026194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-700f5a07-f8da-4802-b33f-4b47f3504a5b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:14.026626 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-700f5a07-f8da-4802-b33f-4b47f3504a5b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:14.036966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-708e3024-ba67-4f92-8e8e-832b8606d8cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:14.037965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-708e3024-ba67-4f92-8e8e-832b8606d8cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:14.046576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-708e3024-ba67-4f92-8e8e-832b8606d8cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:14.047050 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-708e3024-ba67-4f92-8e8e-832b8606d8cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:14.047850 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-708e3024-ba67-4f92-8e8e-832b8606d8cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:14.048285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-708e3024-ba67-4f92-8e8e-832b8606d8cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:14.095351 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-700f5a07-f8da-4802-b33f-4b47f3504a5b tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.082083 Jan 27 16:12:14.096035 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 597/1195] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:14 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:14.120224 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-708e3024-ba67-4f92-8e8e-832b8606d8cd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.087096 Jan 27 16:12:14.121109 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 599/1196] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:14 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:15.107169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ec9f4850-c151-4798-802e-05b49edf73bf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:15.108195 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ec9f4850-c151-4798-802e-05b49edf73bf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:15.115324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec9f4850-c151-4798-802e-05b49edf73bf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:15.115779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec9f4850-c151-4798-802e-05b49edf73bf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:15.116576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec9f4850-c151-4798-802e-05b49edf73bf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:15.117023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ec9f4850-c151-4798-802e-05b49edf73bf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:15.132965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-46712ea7-131d-4c00-8259-758b1ef7ee3b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:15.133994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-46712ea7-131d-4c00-8259-758b1ef7ee3b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:15.142008 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46712ea7-131d-4c00-8259-758b1ef7ee3b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:15.142465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46712ea7-131d-4c00-8259-758b1ef7ee3b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:15.143959 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46712ea7-131d-4c00-8259-758b1ef7ee3b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:15.144401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-46712ea7-131d-4c00-8259-758b1ef7ee3b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:15.192087 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ec9f4850-c151-4798-802e-05b49edf73bf tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.089087 Jan 27 16:12:15.192744 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 598/1197] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:15 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:15.214915 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-46712ea7-131d-4c00-8259-758b1ef7ee3b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.085829 Jan 27 16:12:15.217462 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 600/1198] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:15 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:16.204464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5d035137-9fdf-44ea-a983-66df00f23e57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:16.205491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5d035137-9fdf-44ea-a983-66df00f23e57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:16.216204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d035137-9fdf-44ea-a983-66df00f23e57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:16.216640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d035137-9fdf-44ea-a983-66df00f23e57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:16.217444 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d035137-9fdf-44ea-a983-66df00f23e57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:16.217874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5d035137-9fdf-44ea-a983-66df00f23e57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:16.227513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b0d347e8-3009-463f-a86f-c4ab6dd4ff6f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:16.228896 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b0d347e8-3009-463f-a86f-c4ab6dd4ff6f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:16.236055 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0d347e8-3009-463f-a86f-c4ab6dd4ff6f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:16.236504 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0d347e8-3009-463f-a86f-c4ab6dd4ff6f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:16.237851 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0d347e8-3009-463f-a86f-c4ab6dd4ff6f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:16.238294 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0d347e8-3009-463f-a86f-c4ab6dd4ff6f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:16.285650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5d035137-9fdf-44ea-a983-66df00f23e57 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.085119 Jan 27 16:12:16.286295 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 599/1199] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:16 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:16.312996 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b0d347e8-3009-463f-a86f-c4ab6dd4ff6f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 28660 microversion: 2.20 time: 0.089441 Jan 27 16:12:16.313628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 601/1200] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:16 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 28660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:17.297220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e6bea22f-afc2-4266-8fa5-6722653b72b5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:17.298247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e6bea22f-afc2-4266-8fa5-6722653b72b5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:17.305642 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6bea22f-afc2-4266-8fa5-6722653b72b5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:17.306091 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6bea22f-afc2-4266-8fa5-6722653b72b5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:17.306884 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6bea22f-afc2-4266-8fa5-6722653b72b5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:17.307345 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e6bea22f-afc2-4266-8fa5-6722653b72b5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:17.325793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7fd674cf-ee11-485c-96b6-fadd87feb6de tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:17.326794 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7fd674cf-ee11-485c-96b6-fadd87feb6de tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:17.337191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd674cf-ee11-485c-96b6-fadd87feb6de tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:17.337191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd674cf-ee11-485c-96b6-fadd87feb6de tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:17.337191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd674cf-ee11-485c-96b6-fadd87feb6de tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:17.337191 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7fd674cf-ee11-485c-96b6-fadd87feb6de tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:17.388134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e6bea22f-afc2-4266-8fa5-6722653b72b5 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.094897 Jan 27 16:12:17.388784 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 600/1201] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:17 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:17.416659 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7fd674cf-ee11-485c-96b6-fadd87feb6de tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 29149 microversion: 2.20 time: 0.094855 Jan 27 16:12:17.417598 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 602/1202] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:17 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 29149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:18.400368 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a879ce85-e301-4eb3-b623-25817f85041f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:18.401385 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a879ce85-e301-4eb3-b623-25817f85041f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:18.409281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a879ce85-e301-4eb3-b623-25817f85041f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:18.409724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a879ce85-e301-4eb3-b623-25817f85041f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:18.410530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a879ce85-e301-4eb3-b623-25817f85041f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:18.410964 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a879ce85-e301-4eb3-b623-25817f85041f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:18.429626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5fdf4410-a128-4bc7-a491-571c42829c2a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:18.430773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5fdf4410-a128-4bc7-a491-571c42829c2a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:18.438242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fdf4410-a128-4bc7-a491-571c42829c2a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:18.438691 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fdf4410-a128-4bc7-a491-571c42829c2a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:18.439538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fdf4410-a128-4bc7-a491-571c42829c2a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:18.440069 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fdf4410-a128-4bc7-a491-571c42829c2a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:18.491006 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a879ce85-e301-4eb3-b623-25817f85041f tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.094424 Jan 27 16:12:18.491684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 601/1203] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:18 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:18.526940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5fdf4410-a128-4bc7-a491-571c42829c2a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 31086 microversion: 2.20 time: 0.101852 Jan 27 16:12:18.527673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 603/1204] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:18 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 31086 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:19.181404 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:19.182025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:19.189246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.189700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.191122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.191564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.215672 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lazy-loading 'flavor' on Instance uuid 325464d0-4037-487b-b9b3-c71fb19fb437 {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:12:19.290173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6e608fb7-eb17-4dfd-9e1f-2bd9f74bcb0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "POST /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437/action" status: 202 len: 0 microversion: 2.1 time: 0.112562 Jan 27 16:12:19.290899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 602/1205] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:19 2022] POST /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:19.300471 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:19.301179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:19.309079 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.309699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.310739 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.311266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.451597 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:19.459332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-63a31336-09c3-4f64-b83e-3453c212b88d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.163670 Jan 27 16:12:19.459910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 604/1206] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:19 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:19.508441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-69ad5ed0-d166-4c99-9ba4-b7db23819446 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:19.509426 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-69ad5ed0-d166-4c99-9ba4-b7db23819446 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:19.515521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ad5ed0-d166-4c99-9ba4-b7db23819446 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.515969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ad5ed0-d166-4c99-9ba4-b7db23819446 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.516747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ad5ed0-d166-4c99-9ba4-b7db23819446 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.517177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69ad5ed0-d166-4c99-9ba4-b7db23819446 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.538882 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bc788596-8ee5-43e8-bfc7-19c5418e74a5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:19.539841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bc788596-8ee5-43e8-bfc7-19c5418e74a5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:19.545558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc788596-8ee5-43e8-bfc7-19c5418e74a5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.546012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc788596-8ee5-43e8-bfc7-19c5418e74a5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.550787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc788596-8ee5-43e8-bfc7-19c5418e74a5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:19.550787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bc788596-8ee5-43e8-bfc7-19c5418e74a5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:19.594845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-69ad5ed0-d166-4c99-9ba4-b7db23819446 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.090641 Jan 27 16:12:19.595564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 603/1207] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:19 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:19.634342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bc788596-8ee5-43e8-bfc7-19c5418e74a5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 32719 microversion: 2.20 time: 0.098940 Jan 27 16:12:19.635007 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 605/1208] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:19 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 32719 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:20.476927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:20.477892 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:20.484850 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:20.485305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:20.486082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:20.486520 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:20.607407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2a00765c-d271-42e2-bcf0-088d5003b005 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:20.608450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2a00765c-d271-42e2-bcf0-088d5003b005 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:20.615536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a00765c-d271-42e2-bcf0-088d5003b005 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:20.615990 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a00765c-d271-42e2-bcf0-088d5003b005 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:20.616841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a00765c-d271-42e2-bcf0-088d5003b005 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:20.617232 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2a00765c-d271-42e2-bcf0-088d5003b005 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:20.623829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:20.631790 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-49f752a8-f6af-4752-9ed6-23ddb3a0b4fa tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.158917 Jan 27 16:12:20.632369 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 604/1209] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:20 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:20.646077 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bc005a52-7eca-47bf-a4a9-daa81ae34406 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:20.647029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bc005a52-7eca-47bf-a4a9-daa81ae34406 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:20.653110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc005a52-7eca-47bf-a4a9-daa81ae34406 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:20.653552 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc005a52-7eca-47bf-a4a9-daa81ae34406 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:20.654327 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc005a52-7eca-47bf-a4a9-daa81ae34406 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:20.654758 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bc005a52-7eca-47bf-a4a9-daa81ae34406 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:20.718469 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2a00765c-d271-42e2-bcf0-088d5003b005 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.114992 Jan 27 16:12:20.719164 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 606/1210] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:20 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:20.759149 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bc005a52-7eca-47bf-a4a9-daa81ae34406 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 33613 microversion: 2.20 time: 0.117126 Jan 27 16:12:20.759940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 605/1211] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:20 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 33613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:21.650091 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:21.650789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:21.657688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:21.658138 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:21.659586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:21.660023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:21.731749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-69f7d535-319c-4baa-81eb-23f5e3bfc5d6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:21.732763 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-69f7d535-319c-4baa-81eb-23f5e3bfc5d6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:21.739872 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69f7d535-319c-4baa-81eb-23f5e3bfc5d6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:21.740313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69f7d535-319c-4baa-81eb-23f5e3bfc5d6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:21.741096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69f7d535-319c-4baa-81eb-23f5e3bfc5d6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:21.741521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-69f7d535-319c-4baa-81eb-23f5e3bfc5d6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:21.798853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:21.806306 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1397b0d3-e199-4b39-90d2-cd2f8b22a013 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.160329 Jan 27 16:12:21.806865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 607/1212] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:21 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:21.811334 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-221b43ed-88d9-41b2-bd44-9fcd3c79787a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:21.812228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-221b43ed-88d9-41b2-bd44-9fcd3c79787a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:21.818296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-221b43ed-88d9-41b2-bd44-9fcd3c79787a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:21.818741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-221b43ed-88d9-41b2-bd44-9fcd3c79787a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:21.819540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-221b43ed-88d9-41b2-bd44-9fcd3c79787a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:21.819976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-221b43ed-88d9-41b2-bd44-9fcd3c79787a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:21.827445 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-69f7d535-319c-4baa-81eb-23f5e3bfc5d6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.099829 Jan 27 16:12:21.832215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 606/1213] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:21 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:21.907167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-221b43ed-88d9-41b2-bd44-9fcd3c79787a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 34492 microversion: 2.20 time: 0.098935 Jan 27 16:12:21.907743 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 608/1214] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:21 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 34492 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:22.823931 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:22.824629 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:22.831510 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:22.831961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:22.832745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:22.833188 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:22.840252 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c9e71905-99ca-44da-b1fb-9ae10f557494 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:22.841281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c9e71905-99ca-44da-b1fb-9ae10f557494 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:22.849920 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9e71905-99ca-44da-b1fb-9ae10f557494 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:22.850367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9e71905-99ca-44da-b1fb-9ae10f557494 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:22.851209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9e71905-99ca-44da-b1fb-9ae10f557494 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:22.851647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c9e71905-99ca-44da-b1fb-9ae10f557494 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:22.950188 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c9e71905-99ca-44da-b1fb-9ae10f557494 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.113712 Jan 27 16:12:22.950843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 609/1215] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:22 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:22.956599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3507c8b1-9716-4579-9892-d593a81cdeb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:22.957603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3507c8b1-9716-4579-9892-d593a81cdeb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:22.963823 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3507c8b1-9716-4579-9892-d593a81cdeb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:22.964274 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3507c8b1-9716-4579-9892-d593a81cdeb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:22.965152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3507c8b1-9716-4579-9892-d593a81cdeb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:22.965591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3507c8b1-9716-4579-9892-d593a81cdeb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:22.967935 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:22.976085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1046b493-bc7d-49e8-9483-6bc573a20fb7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.156152 Jan 27 16:12:22.976860 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 607/1216] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:22 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:23.058641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3507c8b1-9716-4579-9892-d593a81cdeb4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 35291 microversion: 2.20 time: 0.106335 Jan 27 16:12:23.059305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 610/1217] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:22 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 35291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:23.962238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0dd65901-024a-4021-aa61-0afc479b0101 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:23.963172 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0dd65901-024a-4021-aa61-0afc479b0101 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:23.969377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd65901-024a-4021-aa61-0afc479b0101 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:23.969823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd65901-024a-4021-aa61-0afc479b0101 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:23.970592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd65901-024a-4021-aa61-0afc479b0101 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:23.971677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0dd65901-024a-4021-aa61-0afc479b0101 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:23.993759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:23.994588 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:24.002595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:24.003072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:24.003862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:24.004326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:24.059266 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0dd65901-024a-4021-aa61-0afc479b0101 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.100471 Jan 27 16:12:24.059947 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 608/1218] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:23 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:24.071068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-172eb52c-cfc5-4d1e-9058-2ec4b6144693 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:24.072185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-172eb52c-cfc5-4d1e-9058-2ec4b6144693 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:24.084441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-172eb52c-cfc5-4d1e-9058-2ec4b6144693 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:24.084898 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-172eb52c-cfc5-4d1e-9058-2ec4b6144693 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:24.085699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-172eb52c-cfc5-4d1e-9058-2ec4b6144693 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:24.086135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-172eb52c-cfc5-4d1e-9058-2ec4b6144693 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:24.146580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:24.154001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-00076ff1-fda0-4aeb-9e90-5d47ce5733c2 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.164192 Jan 27 16:12:24.154567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 611/1219] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:23 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:12:24.176074 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-172eb52c-cfc5-4d1e-9058-2ec4b6144693 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 36439 microversion: 2.20 time: 0.108946 Jan 27 16:12:24.177150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 609/1220] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:24 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 36439 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:25.070901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4f2bdaec-75d6-4930-a639-2aca8fbdebb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:25.071858 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4f2bdaec-75d6-4930-a639-2aca8fbdebb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:25.078345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f2bdaec-75d6-4930-a639-2aca8fbdebb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:25.078801 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f2bdaec-75d6-4930-a639-2aca8fbdebb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:25.079613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f2bdaec-75d6-4930-a639-2aca8fbdebb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:25.080052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f2bdaec-75d6-4930-a639-2aca8fbdebb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:25.157648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4f2bdaec-75d6-4930-a639-2aca8fbdebb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.090240 Jan 27 16:12:25.159086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 612/1221] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:25 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:25.171149 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:25.172064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:25.179567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:25.180016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:25.180819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:25.181222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:25.188458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0be009ba-8ba8-4c66-a50e-54d30c67ef04 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:25.189541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0be009ba-8ba8-4c66-a50e-54d30c67ef04 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:25.196855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0be009ba-8ba8-4c66-a50e-54d30c67ef04 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:25.197373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0be009ba-8ba8-4c66-a50e-54d30c67ef04 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:25.198245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0be009ba-8ba8-4c66-a50e-54d30c67ef04 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:25.198760 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0be009ba-8ba8-4c66-a50e-54d30c67ef04 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:25.291838 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0be009ba-8ba8-4c66-a50e-54d30c67ef04 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 37744 microversion: 2.20 time: 0.107062 Jan 27 16:12:25.293058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 613/1222] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:25 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 37744 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:12:25.324590 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:25.332387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-41d4c19f-2723-4bcf-aae1-8673fc46ae2a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.165347 Jan 27 16:12:25.332955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 610/1223] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:25 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:26.170792 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bb4c1719-326b-4e2a-a75e-f15dab0353ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:26.171825 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bb4c1719-326b-4e2a-a75e-f15dab0353ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:26.179301 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb4c1719-326b-4e2a-a75e-f15dab0353ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:26.179752 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb4c1719-326b-4e2a-a75e-f15dab0353ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:26.180542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb4c1719-326b-4e2a-a75e-f15dab0353ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:26.180984 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bb4c1719-326b-4e2a-a75e-f15dab0353ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:26.251059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bb4c1719-326b-4e2a-a75e-f15dab0353ef tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.084200 Jan 27 16:12:26.251694 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 614/1224] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:26 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:26.304257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bb079a6d-ee5f-4d5b-b9a8-8d2f87058bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:26.305167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bb079a6d-ee5f-4d5b-b9a8-8d2f87058bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:26.311464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb079a6d-ee5f-4d5b-b9a8-8d2f87058bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:26.311914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb079a6d-ee5f-4d5b-b9a8-8d2f87058bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:26.312736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb079a6d-ee5f-4d5b-b9a8-8d2f87058bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:26.313180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bb079a6d-ee5f-4d5b-b9a8-8d2f87058bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:26.349769 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:26.350464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:26.357815 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:26.358266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:26.359072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:26.359511 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:26.387445 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bb079a6d-ee5f-4d5b-b9a8-8d2f87058bf8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 38209 microversion: 2.20 time: 0.086679 Jan 27 16:12:26.391627 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 611/1225] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:26 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 38209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:26.490572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:26.498526 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-95caf68f-542e-42b8-a861-00eec8af72e7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.153187 Jan 27 16:12:26.499123 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 615/1226] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:26 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:12:27.263742 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-573417dc-f32c-4803-9a62-79ae791331c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:27.264785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-573417dc-f32c-4803-9a62-79ae791331c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:27.272913 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-573417dc-f32c-4803-9a62-79ae791331c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:27.273366 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-573417dc-f32c-4803-9a62-79ae791331c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:27.274156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-573417dc-f32c-4803-9a62-79ae791331c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:27.274595 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-573417dc-f32c-4803-9a62-79ae791331c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:27.343925 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-573417dc-f32c-4803-9a62-79ae791331c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.084040 Jan 27 16:12:27.344567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 612/1227] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:27 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:27.399736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-041fa98c-8f03-43c5-bf80-19e833521b58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:27.400653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-041fa98c-8f03-43c5-bf80-19e833521b58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:27.407006 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-041fa98c-8f03-43c5-bf80-19e833521b58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:27.407465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-041fa98c-8f03-43c5-bf80-19e833521b58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:27.408242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-041fa98c-8f03-43c5-bf80-19e833521b58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:27.408684 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-041fa98c-8f03-43c5-bf80-19e833521b58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:27.476976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-041fa98c-8f03-43c5-bf80-19e833521b58 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 38209 microversion: 2.20 time: 0.080768 Jan 27 16:12:27.477857 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 616/1228] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:27 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 38209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:27.515660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:27.516286 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:27.523233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:27.523689 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:27.524471 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:27.524908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:27.659381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:27.666712 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-da8c13fe-f84b-4d2b-9baf-dbb244c9e900 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.155059 Jan 27 16:12:27.667310 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 613/1229] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:27 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:28.356321 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-811c74bd-e0a2-448c-ab23-2d5b728e6aae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:28.357360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-811c74bd-e0a2-448c-ab23-2d5b728e6aae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:28.364788 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-811c74bd-e0a2-448c-ab23-2d5b728e6aae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:28.365240 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-811c74bd-e0a2-448c-ab23-2d5b728e6aae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:28.366034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-811c74bd-e0a2-448c-ab23-2d5b728e6aae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:28.366470 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-811c74bd-e0a2-448c-ab23-2d5b728e6aae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:28.462370 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-811c74bd-e0a2-448c-ab23-2d5b728e6aae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.110259 Jan 27 16:12:28.463087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 617/1230] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:28 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:28.489210 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-41b376c1-2419-47ac-bbca-effa1c7c3eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:28.490338 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-41b376c1-2419-47ac-bbca-effa1c7c3eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:28.496806 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41b376c1-2419-47ac-bbca-effa1c7c3eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:28.497367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41b376c1-2419-47ac-bbca-effa1c7c3eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:28.498144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41b376c1-2419-47ac-bbca-effa1c7c3eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:28.498573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-41b376c1-2419-47ac-bbca-effa1c7c3eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:28.566923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-41b376c1-2419-47ac-bbca-effa1c7c3eff tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 38209 microversion: 2.20 time: 0.081254 Jan 27 16:12:28.567909 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 614/1231] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:28 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 38209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:28.684588 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:28.685269 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:28.692702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:28.693147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:28.693926 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:28.694452 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:28.841520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:28.848963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-39f608f4-e4d0-4e3d-b889-2b6df52369c6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.168380 Jan 27 16:12:28.849570 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 618/1232] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:28 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:29.475170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-635a553b-c478-4d00-a293-3d5ff4288db2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:29.476090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-635a553b-c478-4d00-a293-3d5ff4288db2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:29.483163 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635a553b-c478-4d00-a293-3d5ff4288db2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:29.483631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635a553b-c478-4d00-a293-3d5ff4288db2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:29.484384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635a553b-c478-4d00-a293-3d5ff4288db2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:29.484818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-635a553b-c478-4d00-a293-3d5ff4288db2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:29.555953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-635a553b-c478-4d00-a293-3d5ff4288db2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.085258 Jan 27 16:12:29.556646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 615/1233] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:29 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:29.579795 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cb400ad6-25da-448c-9d55-b4262090e512 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:29.580757 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cb400ad6-25da-448c-9d55-b4262090e512 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:29.588059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb400ad6-25da-448c-9d55-b4262090e512 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:29.588514 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb400ad6-25da-448c-9d55-b4262090e512 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:29.589306 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb400ad6-25da-448c-9d55-b4262090e512 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:29.589742 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cb400ad6-25da-448c-9d55-b4262090e512 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:29.669502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cb400ad6-25da-448c-9d55-b4262090e512 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 38288 microversion: 2.20 time: 0.093443 Jan 27 16:12:29.670194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 619/1234] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:29 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 38288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:29.867070 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:29.867807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:29.874611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:29.875078 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:29.875851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:29.876309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:30.077066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:30.085021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-58facfe9-569b-40fc-9b76-27b04ba4d86d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.222036 Jan 27 16:12:30.085592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 616/1235] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:29 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:30.569113 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-715fc404-05d4-41df-9966-bca32a29aa53 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:30.570100 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-715fc404-05d4-41df-9966-bca32a29aa53 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:30.576853 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-715fc404-05d4-41df-9966-bca32a29aa53 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:30.577299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-715fc404-05d4-41df-9966-bca32a29aa53 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:30.578064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-715fc404-05d4-41df-9966-bca32a29aa53 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:30.578492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-715fc404-05d4-41df-9966-bca32a29aa53 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:30.647158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-715fc404-05d4-41df-9966-bca32a29aa53 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28188 microversion: 2.1 time: 0.082474 Jan 27 16:12:30.647861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 620/1236] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:30 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28188 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:30.681374 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-576a8f1d-54a3-41bc-af37-e38eed822e49 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:30.682292 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-576a8f1d-54a3-41bc-af37-e38eed822e49 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:30.688568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-576a8f1d-54a3-41bc-af37-e38eed822e49 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:30.689016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-576a8f1d-54a3-41bc-af37-e38eed822e49 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:30.690365 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-576a8f1d-54a3-41bc-af37-e38eed822e49 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:30.690800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-576a8f1d-54a3-41bc-af37-e38eed822e49 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:30.766877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-576a8f1d-54a3-41bc-af37-e38eed822e49 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 200 len: 38348 microversion: 2.20 time: 0.089020 Jan 27 16:12:30.767564 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 617/1237] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:30 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 38348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:30.778182 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-97dd37e9-a213-4ffe-b488-2477219ac3db tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:30.778788 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-97dd37e9-a213-4ffe-b488-2477219ac3db tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:30.786394 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-97dd37e9-a213-4ffe-b488-2477219ac3db tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:30.786830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-97dd37e9-a213-4ffe-b488-2477219ac3db tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:30.787639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-97dd37e9-a213-4ffe-b488-2477219ac3db tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:30.788077 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-97dd37e9-a213-4ffe-b488-2477219ac3db tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:30.811942 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-97dd37e9-a213-4ffe-b488-2477219ac3db tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/ips" status: 200 len: 150 microversion: 2.20 time: 0.037945 Jan 27 16:12:30.812501 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 621/1238] 10.222.0.61 () {60 vars in 1288 bytes} [Thu Jan 27 16:12:30 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:31.102848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:31.103573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:31.110423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:31.110866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:31.111746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:31.112217 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:31.245441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:31.253822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ffa9ec4b-eef3-4015-94df-7c31c1129ffd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.155576 Jan 27 16:12:31.254390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 618/1239] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:31 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:31.659741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6282d57b-53d4-4563-9f83-e559d9b40cb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:31.660656 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6282d57b-53d4-4563-9f83-e559d9b40cb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:31.667083 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6282d57b-53d4-4563-9f83-e559d9b40cb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:31.667539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6282d57b-53d4-4563-9f83-e559d9b40cb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:31.668326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6282d57b-53d4-4563-9f83-e559d9b40cb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:31.668765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6282d57b-53d4-4563-9f83-e559d9b40cb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:31.746954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6282d57b-53d4-4563-9f83-e559d9b40cb8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28315 microversion: 2.1 time: 0.091260 Jan 27 16:12:31.747631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 622/1240] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:31 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28315 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:32.270751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:32.271397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:32.277613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:32.278061 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:32.278842 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:32.279303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:32.410072 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:32.417323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5aff9119-f66f-40a8-9026-e7783740415d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.150702 Jan 27 16:12:32.417877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 619/1241] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:32 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:32.759650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4b02c004-74cd-4225-9f60-43cc6bbe7ec6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:32.760687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4b02c004-74cd-4225-9f60-43cc6bbe7ec6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:32.767477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b02c004-74cd-4225-9f60-43cc6bbe7ec6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:32.767924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b02c004-74cd-4225-9f60-43cc6bbe7ec6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:32.768727 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b02c004-74cd-4225-9f60-43cc6bbe7ec6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:32.769159 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b02c004-74cd-4225-9f60-43cc6bbe7ec6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:32.846404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4b02c004-74cd-4225-9f60-43cc6bbe7ec6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28479 microversion: 2.1 time: 0.090647 Jan 27 16:12:32.847162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 623/1242] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:32 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28479 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:33.098655 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:33.099239 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:33.105721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.106168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.106943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.107403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.129521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lazy-loading 'flavor' on Instance uuid 2f2a1a78-ef34-45bd-ac94-52a498c00afc {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:12:33.385599 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-40123300-51dc-477c-b1d1-7db040d6bda9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 202 len: 0 microversion: 2.20 time: 0.291034 Jan 27 16:12:33.386236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 620/1243] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:12:33 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:12:33.395031 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:33.395755 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:33.402784 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.403304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.404060 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.404498 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.434199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:33.434886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:33.441220 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.441667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.442443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.442874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.538786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:33.546428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:33.547943 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:33.549641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-51c416de-c841-409e-b6d9-bdc5a357bce5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.158622 Jan 27 16:12:33.550263 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 624/1244] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:33 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:33.578937 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:33.586949 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a4979b36-a5c0-4d49-a1b0-b915788cb886 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1511 microversion: 2.1 time: 0.156733 Jan 27 16:12:33.587553 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 621/1245] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:33 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:12:33.607290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9a484af8-94ee-42f1-adc3-1d1e4dd51abe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:33.607859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9a484af8-94ee-42f1-adc3-1d1e4dd51abe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:33.613712 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a484af8-94ee-42f1-adc3-1d1e4dd51abe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.614157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a484af8-94ee-42f1-adc3-1d1e4dd51abe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.614929 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a484af8-94ee-42f1-adc3-1d1e4dd51abe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.615390 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a484af8-94ee-42f1-adc3-1d1e4dd51abe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.699999 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9a484af8-94ee-42f1-adc3-1d1e4dd51abe tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "POST /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437/action" status: 202 len: 0 microversion: 2.1 time: 0.096131 Jan 27 16:12:33.700604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 625/1246] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:33 2022] POST /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:12:33.708894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:33.709628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:33.716231 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.716759 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.717648 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.718175 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.858210 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ff73e076-39ae-4cc6-9c91-12da0d38a754 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:33.859368 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ff73e076-39ae-4cc6-9c91-12da0d38a754 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:33.862214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:33.867613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff73e076-39ae-4cc6-9c91-12da0d38a754 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.868291 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff73e076-39ae-4cc6-9c91-12da0d38a754 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.869154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff73e076-39ae-4cc6-9c91-12da0d38a754 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:33.869593 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff73e076-39ae-4cc6-9c91-12da0d38a754 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:33.869896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fe5e9738-b60b-436b-a354-e1892552ad35 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1519 microversion: 2.1 time: 0.165162 Jan 27 16:12:33.871018 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 622/1247] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:33 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:33.951231 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ff73e076-39ae-4cc6-9c91-12da0d38a754 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.096763 Jan 27 16:12:33.952600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 626/1248] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:33 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:34.568853 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:34.569412 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:34.575332 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:34.575786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:34.576579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:34.577021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:34.706573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:34.715039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:34.716671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:34.717827 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-57c714be-1f2f-40c8-8232-415bc2f85c8e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.152850 Jan 27 16:12:34.718388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 623/1249] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:34 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:34.887977 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:34.888802 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:34.896739 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:34.897494 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:34.898452 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:34.899125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:34.964085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c9e68396-9583-4b89-af9e-c5dd28843103 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:34.964958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c9e68396-9583-4b89-af9e-c5dd28843103 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:34.970713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9e68396-9583-4b89-af9e-c5dd28843103 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:34.971200 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9e68396-9583-4b89-af9e-c5dd28843103 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:34.971993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9e68396-9583-4b89-af9e-c5dd28843103 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:34.972429 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9e68396-9583-4b89-af9e-c5dd28843103 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:35.030295 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:35.038817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a380238f-665e-4e51-b8c3-751e5a4c83f4 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.154895 Jan 27 16:12:35.039416 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 627/1250] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:34 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:35.045214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c9e68396-9583-4b89-af9e-c5dd28843103 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.084712 Jan 27 16:12:35.046036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 624/1251] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:34 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:35.458516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-dec2ed88-a062-45cf-a0cf-5f38ebd6cfd2 req-629d9515-33ee-4332-9437-097c4c59ebd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325464d0-4037-487b-b9b3-c71fb19fb437", "name": "network-vif-unplugged", "status": "completed", "tag": "ad7c7c1a-2840-4fc3-8560-37a45a3feea6"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:35.460167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:12:35.460167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:12:35.468239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-dec2ed88-a062-45cf-a0cf-5f38ebd6cfd2 req-629d9515-33ee-4332-9437-097c4c59ebd4 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:35.468750 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-dec2ed88-a062-45cf-a0cf-5f38ebd6cfd2 req-629d9515-33ee-4332-9437-097c4c59ebd4 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:35.480950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-dec2ed88-a062-45cf-a0cf-5f38ebd6cfd2 req-629d9515-33ee-4332-9437-097c4c59ebd4 service nova] Creating event network-vif-unplugged:ad7c7c1a-2840-4fc3-8560-37a45a3feea6 for instance 325464d0-4037-487b-b9b3-c71fb19fb437 on hv-cinder-82635 Jan 27 16:12:35.485699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-dec2ed88-a062-45cf-a0cf-5f38ebd6cfd2 req-629d9515-33ee-4332-9437-097c4c59ebd4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031560 Jan 27 16:12:35.486358 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 628/1252] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:12:35.737829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:35.738420 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:35.748384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:35.748912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:35.749699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:35.750132 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:35.882501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:35.890655 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:35.892190 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:35.893341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e8b00f73-53f5-4b74-a8f0-130dd7fbf2dc tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.159693 Jan 27 16:12:35.893904 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 625/1253] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:35 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:36.057083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7ee0ec05-c187-42df-94a2-c1fced233bdc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:36.057859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:36.058344 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7ee0ec05-c187-42df-94a2-c1fced233bdc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:36.058565 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:36.064264 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee0ec05-c187-42df-94a2-c1fced233bdc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:36.064508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:36.064711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee0ec05-c187-42df-94a2-c1fced233bdc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:36.064962 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:36.065491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee0ec05-c187-42df-94a2-c1fced233bdc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:36.065732 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:36.065928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee0ec05-c187-42df-94a2-c1fced233bdc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:36.066166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:36.186088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7ee0ec05-c187-42df-94a2-c1fced233bdc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.132460 Jan 27 16:12:36.186743 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 626/1254] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:36 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:36.199420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:36.207446 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4d3b4062-7bdb-46f9-b1e2-a4778bf2ecba tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.153859 Jan 27 16:12:36.208179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 629/1255] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:36 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:36.911844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:36.912562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:36.919466 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:36.919917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:36.920715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:36.921151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:37.049942 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:37.058275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:37.059796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:37.060930 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-378f5042-3fc0-43e1-872f-16e2035fd713 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.153159 Jan 27 16:12:37.061467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 627/1256] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:36 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:12:37.198277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8702964a-9254-43f2-8108-a024e338440e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:37.199130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8702964a-9254-43f2-8108-a024e338440e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:37.205323 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8702964a-9254-43f2-8108-a024e338440e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:37.205762 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8702964a-9254-43f2-8108-a024e338440e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:37.206526 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8702964a-9254-43f2-8108-a024e338440e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:37.206950 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8702964a-9254-43f2-8108-a024e338440e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:37.224612 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:37.225251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:37.231712 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:37.232534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:37.232952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:37.233406 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:37.283916 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8702964a-9254-43f2-8108-a024e338440e tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.089050 Jan 27 16:12:37.289538 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 630/1257] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:37 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:37.361845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:37.369717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fd936e5e-8614-4d4b-9850-2afc8bf194ee tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.148738 Jan 27 16:12:37.370275 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 628/1258] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:37 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:12:38.080058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:38.080755 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:38.088127 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:38.088578 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:38.089359 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:38.089796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:38.215381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:38.224103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:38.225612 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:38.227040 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3c3159e1-6197-46ab-b416-ae56ccc676d8 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.150795 Jan 27 16:12:38.227616 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 631/1259] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:38 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:38.297012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-28b61d45-6569-4c9c-8238-d988dae25ba1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:38.297923 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-28b61d45-6569-4c9c-8238-d988dae25ba1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:38.304185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-28b61d45-6569-4c9c-8238-d988dae25ba1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:38.304631 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-28b61d45-6569-4c9c-8238-d988dae25ba1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:38.305404 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-28b61d45-6569-4c9c-8238-d988dae25ba1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:38.305837 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-28b61d45-6569-4c9c-8238-d988dae25ba1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:38.367216 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-28b61d45-6569-4c9c-8238-d988dae25ba1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.073518 Jan 27 16:12:38.367993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 629/1260] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:38 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:38.386650 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:38.387302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:38.393633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:38.394085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:38.395539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:38.395980 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:38.525848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:38.532959 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8c99b77e-b1ba-4b59-98d4-b2fb0362e03a tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.149999 Jan 27 16:12:38.533511 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 632/1261] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:38 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:39.245989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:39.246673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:39.253457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:39.253903 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:39.254665 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:39.255120 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:39.378760 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6efd7252-5977-49fa-9f08-2dc0d5f778e6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:39.379706 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6efd7252-5977-49fa-9f08-2dc0d5f778e6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:39.386495 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6efd7252-5977-49fa-9f08-2dc0d5f778e6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:39.386971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6efd7252-5977-49fa-9f08-2dc0d5f778e6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:39.387908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6efd7252-5977-49fa-9f08-2dc0d5f778e6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:39.388225 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6efd7252-5977-49fa-9f08-2dc0d5f778e6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:39.390210 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:39.398618 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:39.400134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:39.401301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cf452c24-8181-45fb-b7c9-b5a16f18e4c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.159353 Jan 27 16:12:39.401844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 630/1262] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:39 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:39.452499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6efd7252-5977-49fa-9f08-2dc0d5f778e6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.077291 Jan 27 16:12:39.453128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 633/1263] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:39 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:39.549457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:39.550361 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:39.556382 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:39.556832 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:39.557611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:39.558047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:39.686064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:39.693281 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4ff41111-3d55-4314-853a-cee2181ffd0d tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.147515 Jan 27 16:12:39.693846 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 631/1264] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:39 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:40.420451 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:40.421146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:40.428583 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:40.429056 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:40.429846 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:40.430286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:40.463676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9dd24288-72c3-4b66-b362-c824b34735b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:40.464596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9dd24288-72c3-4b66-b362-c824b34735b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:40.470837 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9dd24288-72c3-4b66-b362-c824b34735b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:40.471321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9dd24288-72c3-4b66-b362-c824b34735b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:40.472106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9dd24288-72c3-4b66-b362-c824b34735b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:40.472545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9dd24288-72c3-4b66-b362-c824b34735b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:40.541655 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9dd24288-72c3-4b66-b362-c824b34735b2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.081358 Jan 27 16:12:40.545610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 632/1265] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:40 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:40.563480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:40.571584 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:40.573183 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:40.574582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0bd293d9-649b-4dee-9152-f10797867441 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.158161 Jan 27 16:12:40.575217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 634/1266] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:40 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:40.709863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:40.710593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:40.717529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:40.717982 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:40.718768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:40.719232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:40.857584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:40.865049 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-51b162ae-2a0e-4260-93ff-a2a1f6f81032 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.159224 Jan 27 16:12:40.865610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 633/1267] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:40 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:41.554114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ff99d9aa-eced-41b7-8eb1-fbfa544323fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:41.555043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ff99d9aa-eced-41b7-8eb1-fbfa544323fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:41.561240 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff99d9aa-eced-41b7-8eb1-fbfa544323fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:41.561679 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff99d9aa-eced-41b7-8eb1-fbfa544323fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:41.562444 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff99d9aa-eced-41b7-8eb1-fbfa544323fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:41.562872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ff99d9aa-eced-41b7-8eb1-fbfa544323fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:41.593534 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:41.594043 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:41.600199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:41.600640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:41.601674 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:41.602099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:41.624977 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ff99d9aa-eced-41b7-8eb1-fbfa544323fa tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.074589 Jan 27 16:12:41.628819 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 635/1268] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:41 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:41.726917 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:41.734901 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:41.736431 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:41.737572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-13ae61df-db9c-47e6-90b5-82e63a54a7ae tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.148685 Jan 27 16:12:41.738121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 634/1269] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:41 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:12:41.882839 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:41.883654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:41.890729 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:41.891244 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:41.892025 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:41.892465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:42.020688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:42.028395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d6ee3a24-95d4-4e91-86ef-222771fb8276 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.150235 Jan 27 16:12:42.028957 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 636/1270] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:41 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:42.640265 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-61fa83ec-01bc-4654-b20a-0ae65e8ca5ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:42.641183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-61fa83ec-01bc-4654-b20a-0ae65e8ca5ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:42.648696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-61fa83ec-01bc-4654-b20a-0ae65e8ca5ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:42.649151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-61fa83ec-01bc-4654-b20a-0ae65e8ca5ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:42.649938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-61fa83ec-01bc-4654-b20a-0ae65e8ca5ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:42.650383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-61fa83ec-01bc-4654-b20a-0ae65e8ca5ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:42.720026 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-61fa83ec-01bc-4654-b20a-0ae65e8ca5ac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.081962 Jan 27 16:12:42.721153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 635/1271] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:42 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:42.756597 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:42.757166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:42.763471 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:42.763918 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:42.764689 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:42.765119 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:42.896138 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:42.903861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:42.905363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:42.906507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d00672fe-e8e0-4629-8561-2a57d364578d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.154226 Jan 27 16:12:42.907074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 637/1272] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:42 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:43.045845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:43.046533 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:43.054305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:43.054768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:43.055596 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:43.056038 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:43.196921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:43.204508 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-798ad819-e3a8-4a23-a891-02b91094c8a6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.162581 Jan 27 16:12:43.205180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 636/1273] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:43 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:43.732976 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ebbd18b2-db9a-45a8-979b-3e75db49f322 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:43.733885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ebbd18b2-db9a-45a8-979b-3e75db49f322 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:43.740762 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebbd18b2-db9a-45a8-979b-3e75db49f322 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:43.741209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebbd18b2-db9a-45a8-979b-3e75db49f322 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:43.741985 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebbd18b2-db9a-45a8-979b-3e75db49f322 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:43.742417 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebbd18b2-db9a-45a8-979b-3e75db49f322 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:43.802634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ebbd18b2-db9a-45a8-979b-3e75db49f322 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.073134 Jan 27 16:12:43.803302 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 638/1274] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:43 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:43.924086 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:43.924694 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:43.930973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:43.931461 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:43.932245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:43.932686 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:44.058478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:44.066135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:44.067707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:44.068851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9e123c5d-21e2-41ce-989a-41601009d9c7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.148515 Jan 27 16:12:44.069408 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 637/1275] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:43 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:44.221821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:44.222515 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:44.230305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:44.230749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:44.231548 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:44.231984 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:44.364830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:44.372790 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a29fb954-5f3d-4cf4-a78d-869aa691879b tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1577 microversion: 2.1 time: 0.154970 Jan 27 16:12:44.373340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 639/1276] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:44 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:44.814251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-17b3d884-b316-49eb-bbe8-07e7c848a426 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:44.815529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-17b3d884-b316-49eb-bbe8-07e7c848a426 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:44.822514 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17b3d884-b316-49eb-bbe8-07e7c848a426 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:44.822969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17b3d884-b316-49eb-bbe8-07e7c848a426 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:44.823796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17b3d884-b316-49eb-bbe8-07e7c848a426 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:44.824230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-17b3d884-b316-49eb-bbe8-07e7c848a426 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:44.896135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-17b3d884-b316-49eb-bbe8-07e7c848a426 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.084635 Jan 27 16:12:44.897280 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 638/1277] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:44 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:45.087128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:45.087665 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:45.094056 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:45.094562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:45.095422 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:45.095927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:45.226586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:45.234277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:45.235817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:45.236975 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f7309fba-8c67-4413-81b3-722cc1d21ff9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1740 microversion: 2.20 time: 0.153675 Jan 27 16:12:45.237544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 640/1278] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:45 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:12:45.390106 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:45.390840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:45.397700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:45.398154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:45.398965 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:45.399430 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:45.543645 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:45.552610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d4e55b19-9757-4580-9da0-f12029ea9ab7 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1564 microversion: 2.1 time: 0.166059 Jan 27 16:12:45.553180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 639/1279] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:12:45 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:12:45.908783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e2ac66ad-0367-4da4-83e1-a492bde3bdb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:45.909701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e2ac66ad-0367-4da4-83e1-a492bde3bdb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:45.916642 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e2ac66ad-0367-4da4-83e1-a492bde3bdb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:45.917096 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e2ac66ad-0367-4da4-83e1-a492bde3bdb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:45.917908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e2ac66ad-0367-4da4-83e1-a492bde3bdb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:45.918351 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e2ac66ad-0367-4da4-83e1-a492bde3bdb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:46.027443 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e2ac66ad-0367-4da4-83e1-a492bde3bdb6 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.122265 Jan 27 16:12:46.028321 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 641/1280] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:45 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:46.255821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:46.256377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:46.262502 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:46.262951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:46.263757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:46.264192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:46.389970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:46.397624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:46.399152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:46.400297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e185ea6c-bb28-46e6-8b6d-c38e429ee5e1 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1740 microversion: 2.20 time: 0.148324 Jan 27 16:12:46.400855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 640/1281] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:46 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1740 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:47.039964 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d2c98b44-c878-4a01-81b3-5f496b7f4f06 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:47.040956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d2c98b44-c878-4a01-81b3-5f496b7f4f06 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:47.048233 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2c98b44-c878-4a01-81b3-5f496b7f4f06 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:47.048689 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2c98b44-c878-4a01-81b3-5f496b7f4f06 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:47.049482 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2c98b44-c878-4a01-81b3-5f496b7f4f06 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:47.049925 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d2c98b44-c878-4a01-81b3-5f496b7f4f06 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:47.153088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d2c98b44-c878-4a01-81b3-5f496b7f4f06 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.117508 Jan 27 16:12:47.153736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 642/1282] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:47 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:47.418375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:47.419025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:47.425695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:47.426150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:47.426993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:47.427437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:47.611131 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:47.620818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:47.622352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:47.623578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4d10f863-07bf-4506-9df9-c405cee79ecf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1740 microversion: 2.20 time: 0.208932 Jan 27 16:12:47.624130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 641/1283] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:47 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:47.721590 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-03b737ba-ed47-4f52-9a27-f80c3bd0bfbe req-123ea366-8770-4c18-9c64-da9bbf56950b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325464d0-4037-487b-b9b3-c71fb19fb437", "name": "network-vif-plugged", "status": "completed", "tag": "ad7c7c1a-2840-4fc3-8560-37a45a3feea6"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:47.723152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:12:47.723152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:12:47.731906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-03b737ba-ed47-4f52-9a27-f80c3bd0bfbe req-123ea366-8770-4c18-9c64-da9bbf56950b service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:47.732352 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-03b737ba-ed47-4f52-9a27-f80c3bd0bfbe req-123ea366-8770-4c18-9c64-da9bbf56950b service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:47.744570 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-03b737ba-ed47-4f52-9a27-f80c3bd0bfbe req-123ea366-8770-4c18-9c64-da9bbf56950b service nova] Creating event network-vif-plugged:ad7c7c1a-2840-4fc3-8560-37a45a3feea6 for instance 325464d0-4037-487b-b9b3-c71fb19fb437 on hv-cinder-82635 Jan 27 16:12:47.749468 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-03b737ba-ed47-4f52-9a27-f80c3bd0bfbe req-123ea366-8770-4c18-9c64-da9bbf56950b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jan 27 16:12:47.750245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 643/1284] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:12:48.165449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bedd8bdd-4bef-4a6b-b984-fdc38babd7b9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:48.166268 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bedd8bdd-4bef-4a6b-b984-fdc38babd7b9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:48.172580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bedd8bdd-4bef-4a6b-b984-fdc38babd7b9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:48.173027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bedd8bdd-4bef-4a6b-b984-fdc38babd7b9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:48.173792 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bedd8bdd-4bef-4a6b-b984-fdc38babd7b9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:48.174252 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bedd8bdd-4bef-4a6b-b984-fdc38babd7b9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:48.233839 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bedd8bdd-4bef-4a6b-b984-fdc38babd7b9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.072553 Jan 27 16:12:48.234521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 642/1285] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:48 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:48.643340 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:48.644030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:48.650969 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:48.651461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:48.652262 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:48.652698 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:48.828318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:48.836063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:48.837541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:48.838673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1c404c07-82d8-481c-8ffc-236618e0993d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1740 microversion: 2.20 time: 0.199908 Jan 27 16:12:48.839272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 644/1286] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:48 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:49.246821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-688d2e3b-a69f-466c-bbc4-32f0bf22dc23 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:49.247841 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-688d2e3b-a69f-466c-bbc4-32f0bf22dc23 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:49.254788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-688d2e3b-a69f-466c-bbc4-32f0bf22dc23 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:49.255258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-688d2e3b-a69f-466c-bbc4-32f0bf22dc23 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:49.256045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-688d2e3b-a69f-466c-bbc4-32f0bf22dc23 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:49.256781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-688d2e3b-a69f-466c-bbc4-32f0bf22dc23 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:49.339588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-688d2e3b-a69f-466c-bbc4-32f0bf22dc23 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.096218 Jan 27 16:12:49.340593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 643/1287] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:49 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:49.764633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-3839ce2d-b07b-47b6-a237-3f9bfbc3f912 req-d184ef2e-a2dc-4c92-96b8-1327d4b51efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2a1a78-ef34-45bd-ac94-52a498c00afc", "name": "network-vif-plugged", "status": "completed", "tag": "65f08781-43d4-4145-addc-4b4981e01510"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:49.766160 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:12:49.766160 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:12:49.774017 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-3839ce2d-b07b-47b6-a237-3f9bfbc3f912 req-d184ef2e-a2dc-4c92-96b8-1327d4b51efe service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:49.774456 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-3839ce2d-b07b-47b6-a237-3f9bfbc3f912 req-d184ef2e-a2dc-4c92-96b8-1327d4b51efe service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:49.786363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-3839ce2d-b07b-47b6-a237-3f9bfbc3f912 req-d184ef2e-a2dc-4c92-96b8-1327d4b51efe service nova] Creating event network-vif-plugged:65f08781-43d4-4145-addc-4b4981e01510 for instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc on hv-cinder-82635 Jan 27 16:12:49.791173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-3839ce2d-b07b-47b6-a237-3f9bfbc3f912 req-d184ef2e-a2dc-4c92-96b8-1327d4b51efe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030161 Jan 27 16:12:49.791753 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 645/1288] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:12:49.858301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:49.859040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:49.866229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:49.866671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:49.867467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:49.867896 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:49.997932 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:50.006579 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:50.008155 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:50.009302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fb5edcb3-1739-4dbf-b710-ba10e183925c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1740 microversion: 2.20 time: 0.155116 Jan 27 16:12:50.009861 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 644/1289] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:49 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:50.351557 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-42f60319-f4d0-4cc5-83dd-20cbec9a9955 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:50.352541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-42f60319-f4d0-4cc5-83dd-20cbec9a9955 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:50.359428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-42f60319-f4d0-4cc5-83dd-20cbec9a9955 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:50.359865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-42f60319-f4d0-4cc5-83dd-20cbec9a9955 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:50.360641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-42f60319-f4d0-4cc5-83dd-20cbec9a9955 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:50.361067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-42f60319-f4d0-4cc5-83dd-20cbec9a9955 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:50.448164 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-42f60319-f4d0-4cc5-83dd-20cbec9a9955 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.100213 Jan 27 16:12:50.449317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 646/1290] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:50 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:51.027150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:51.027773 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:51.033996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:51.034446 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:51.035259 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:51.036374 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:51.166565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:51.174407 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:51.175926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:51.177073 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a9e2602d-1b09-428f-b323-d3b626f881e5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1740 microversion: 2.20 time: 0.153642 Jan 27 16:12:51.177641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 645/1291] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:51 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:51.460351 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-358c7c63-1a19-4eaa-9a84-62bda64379fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:51.461347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-358c7c63-1a19-4eaa-9a84-62bda64379fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:51.468286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-358c7c63-1a19-4eaa-9a84-62bda64379fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:51.468741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-358c7c63-1a19-4eaa-9a84-62bda64379fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:51.469516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-358c7c63-1a19-4eaa-9a84-62bda64379fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:51.469949 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-358c7c63-1a19-4eaa-9a84-62bda64379fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:51.538415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-358c7c63-1a19-4eaa-9a84-62bda64379fb tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.082519 Jan 27 16:12:51.539334 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 647/1292] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:51 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:52.195156 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:52.195791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:52.202398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:52.202721 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:52.203545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:52.204005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:52.354945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:52.363053 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:52.365124 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:52.366288 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-160c1e4b-140b-4633-9652-d085dd89214a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.174821 Jan 27 16:12:52.373857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 646/1293] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:52 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:52.552150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5a3959f1-ce33-46c4-83ec-4da10ef245d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:52.553928 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5a3959f1-ce33-46c4-83ec-4da10ef245d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:52.561377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a3959f1-ce33-46c4-83ec-4da10ef245d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:52.562040 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a3959f1-ce33-46c4-83ec-4da10ef245d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:52.563048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a3959f1-ce33-46c4-83ec-4da10ef245d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:52.563490 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5a3959f1-ce33-46c4-83ec-4da10ef245d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:52.637067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5a3959f1-ce33-46c4-83ec-4da10ef245d3 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.089112 Jan 27 16:12:52.638067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 648/1294] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:52 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:53.392340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:53.392941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:53.399962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:53.400417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:53.401410 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:53.401851 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:53.545448 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:53.554667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:53.556292 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:53.557755 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a347c83d-cef0-4b0a-9d9a-a336756b3939 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.169249 Jan 27 16:12:53.569211 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 647/1295] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:53 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:53.649702 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-13b92c2a-10ad-4584-a8ad-ad85d949e962 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:53.651122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-13b92c2a-10ad-4584-a8ad-ad85d949e962 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:53.658088 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13b92c2a-10ad-4584-a8ad-ad85d949e962 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:53.658617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13b92c2a-10ad-4584-a8ad-ad85d949e962 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:53.659502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13b92c2a-10ad-4584-a8ad-ad85d949e962 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:53.659937 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13b92c2a-10ad-4584-a8ad-ad85d949e962 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:53.730087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-13b92c2a-10ad-4584-a8ad-ad85d949e962 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.084129 Jan 27 16:12:53.734937 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 649/1296] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:53 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:54.575814 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:54.577131 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:54.584160 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:54.584845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:54.585629 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:54.586058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:54.742686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-90860213-76f0-4e37-91da-1b452d6a5420 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:54.743709 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-90860213-76f0-4e37-91da-1b452d6a5420 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:54.750858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:54.751972 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90860213-76f0-4e37-91da-1b452d6a5420 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:54.754874 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90860213-76f0-4e37-91da-1b452d6a5420 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:54.755718 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90860213-76f0-4e37-91da-1b452d6a5420 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:54.756310 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-90860213-76f0-4e37-91da-1b452d6a5420 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:54.761490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:54.762201 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:54.763508 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e8f9e415-7f45-4b46-a906-c18c2d0475cb tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.191416 Jan 27 16:12:54.764161 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 648/1297] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:54 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:54.838842 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-90860213-76f0-4e37-91da-1b452d6a5420 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.100411 Jan 27 16:12:54.839657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 650/1298] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:54 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:55.781628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:55.782218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:55.789208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:55.789676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:55.790462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:55.790899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:55.853800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-09bba14e-2d90-455c-a892-458c46354904 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:55.854916 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-09bba14e-2d90-455c-a892-458c46354904 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:55.862540 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-09bba14e-2d90-455c-a892-458c46354904 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:55.863331 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-09bba14e-2d90-455c-a892-458c46354904 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:55.864384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-09bba14e-2d90-455c-a892-458c46354904 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:55.864887 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-09bba14e-2d90-455c-a892-458c46354904 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:55.931258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-09bba14e-2d90-455c-a892-458c46354904 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.083407 Jan 27 16:12:55.933116 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 651/1299] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:55 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:55.935021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:55.944889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:55.947212 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:55.948382 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5ba433ef-5732-43e8-a66f-9dd267060170 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.170676 Jan 27 16:12:55.951015 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 649/1300] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:55 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:56.943179 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3a92ae64-4aa6-47b3-9e0b-354bd8cb1312 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:56.944183 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3a92ae64-4aa6-47b3-9e0b-354bd8cb1312 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:56.953203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a92ae64-4aa6-47b3-9e0b-354bd8cb1312 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:56.953654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a92ae64-4aa6-47b3-9e0b-354bd8cb1312 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:56.954448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a92ae64-4aa6-47b3-9e0b-354bd8cb1312 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:56.954886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3a92ae64-4aa6-47b3-9e0b-354bd8cb1312 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:56.967761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:56.968521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:56.976808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:56.977360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:56.979074 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:56.979794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:57.032413 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3a92ae64-4aa6-47b3-9e0b-354bd8cb1312 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.092940 Jan 27 16:12:57.036997 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 652/1301] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:56 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:57.137153 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:57.150247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:57.152921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:57.154452 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bd50e788-e36c-4bc4-abd6-d5b3c318009f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.191088 Jan 27 16:12:57.155459 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 650/1302] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:56 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:12:58.044993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-841a6bff-898d-404d-ba39-66b1d888ea91 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:58.046037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-841a6bff-898d-404d-ba39-66b1d888ea91 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:58.053897 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-841a6bff-898d-404d-ba39-66b1d888ea91 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:58.054345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-841a6bff-898d-404d-ba39-66b1d888ea91 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:58.055177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-841a6bff-898d-404d-ba39-66b1d888ea91 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:58.055617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-841a6bff-898d-404d-ba39-66b1d888ea91 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:58.125024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-841a6bff-898d-404d-ba39-66b1d888ea91 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.084066 Jan 27 16:12:58.125669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 653/1303] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:58 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:12:58.174219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:58.174823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:58.183095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:58.183577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:58.184848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:58.185325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:58.348064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:58.360204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:58.362032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:58.364242 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4e9d996c-edc2-42e0-a672-b2ab214bca39 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.192834 Jan 27 16:12:58.365403 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 651/1304] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:58 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:12:59.140527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e38d2d46-4dd2-4611-bdac-96357abf4ca2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:12:59.141556 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e38d2d46-4dd2-4611-bdac-96357abf4ca2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:59.153881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e38d2d46-4dd2-4611-bdac-96357abf4ca2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:59.154520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e38d2d46-4dd2-4611-bdac-96357abf4ca2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:59.155589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e38d2d46-4dd2-4611-bdac-96357abf4ca2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:59.156034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e38d2d46-4dd2-4611-bdac-96357abf4ca2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:59.255459 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e38d2d46-4dd2-4611-bdac-96357abf4ca2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.120128 Jan 27 16:12:59.256701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 654/1305] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:12:59 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:12:59.383662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:12:59.384318 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:12:59.390843 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:59.391349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:59.392222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:12:59.393013 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:12:59.527668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:59.540126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:59.542789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:12:59.544882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d0471e00-8c8d-46e0-ab18-b1caeb5c8633 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.165690 Jan 27 16:12:59.545819 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 652/1306] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:12:59 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:00.268835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ade32a25-e8a0-4ec8-937c-9f42a3205013 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:00.270873 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ade32a25-e8a0-4ec8-937c-9f42a3205013 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:00.278022 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ade32a25-e8a0-4ec8-937c-9f42a3205013 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:00.278476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ade32a25-e8a0-4ec8-937c-9f42a3205013 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:00.279294 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ade32a25-e8a0-4ec8-937c-9f42a3205013 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:00.279732 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ade32a25-e8a0-4ec8-937c-9f42a3205013 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:00.346175 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ade32a25-e8a0-4ec8-937c-9f42a3205013 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.081481 Jan 27 16:13:00.347983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 655/1307] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:00 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:00.691849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:00.693133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:00.699679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:00.700541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:00.701647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:00.702462 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:01.071003 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:01.081436 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:01.087194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:01.089128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e64fa35c-44eb-425e-9f2a-488f0c9eec93 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.521121 Jan 27 16:13:01.104401 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 653/1308] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:00 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:01.360413 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c0a841c8-9404-4f17-8a87-88e649a5e591 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:01.362052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c0a841c8-9404-4f17-8a87-88e649a5e591 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:01.370498 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c0a841c8-9404-4f17-8a87-88e649a5e591 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:01.371492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c0a841c8-9404-4f17-8a87-88e649a5e591 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:01.372903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c0a841c8-9404-4f17-8a87-88e649a5e591 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:01.373643 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c0a841c8-9404-4f17-8a87-88e649a5e591 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:01.448968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c0a841c8-9404-4f17-8a87-88e649a5e591 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.093040 Jan 27 16:13:01.449847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 656/1309] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:01 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:02.114636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:02.115344 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:02.122234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:02.123082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:02.124122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:02.124667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:02.269807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:02.278554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:02.280076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:02.281285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b5985a27-5658-481d-80c0-b05d434fc7b5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.170458 Jan 27 16:13:02.281831 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 654/1310] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:02 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:02.466509 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fb05cd9b-aa96-45c8-9e22-62a062b19042 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:02.467890 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fb05cd9b-aa96-45c8-9e22-62a062b19042 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:02.476678 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb05cd9b-aa96-45c8-9e22-62a062b19042 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:02.477490 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb05cd9b-aa96-45c8-9e22-62a062b19042 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:02.478969 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb05cd9b-aa96-45c8-9e22-62a062b19042 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:02.479434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb05cd9b-aa96-45c8-9e22-62a062b19042 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:02.557315 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fb05cd9b-aa96-45c8-9e22-62a062b19042 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.098286 Jan 27 16:13:02.560782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 657/1311] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:02 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:03.299951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:03.300885 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:03.308794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:03.309491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:03.310530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:03.310987 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:03.466058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:03.474402 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:03.476320 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:03.477630 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-66d29be1-0975-4ec0-b592-9eca3fa6fe55 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.181971 Jan 27 16:13:03.478442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 655/1312] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:03 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:03.569167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ad32c9e2-ea9f-499d-b909-472e1cfce43c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:03.570892 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ad32c9e2-ea9f-499d-b909-472e1cfce43c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:03.578108 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad32c9e2-ea9f-499d-b909-472e1cfce43c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:03.578639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad32c9e2-ea9f-499d-b909-472e1cfce43c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:03.579543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad32c9e2-ea9f-499d-b909-472e1cfce43c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:03.580057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ad32c9e2-ea9f-499d-b909-472e1cfce43c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:03.642001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ad32c9e2-ea9f-499d-b909-472e1cfce43c tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.077244 Jan 27 16:13:03.642791 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 658/1313] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:03 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:04.495757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:04.496345 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:04.502614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:04.503095 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:04.503867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:04.504920 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:04.633229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:04.641093 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:04.642723 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:04.643894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0b3f1742-1d98-4d8d-bf9c-3fe8d7523e98 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1735 microversion: 2.20 time: 0.151817 Jan 27 16:13:04.644452 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 656/1314] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:04 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:04.654072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d8321ceb-ef51-4e17-994e-cc575ebba31d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:04.655102 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d8321ceb-ef51-4e17-994e-cc575ebba31d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:04.661981 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8321ceb-ef51-4e17-994e-cc575ebba31d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:04.662434 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8321ceb-ef51-4e17-994e-cc575ebba31d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:04.663239 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8321ceb-ef51-4e17-994e-cc575ebba31d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:04.663673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d8321ceb-ef51-4e17-994e-cc575ebba31d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:04.729009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d8321ceb-ef51-4e17-994e-cc575ebba31d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.078784 Jan 27 16:13:04.732865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 659/1315] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:04 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:05.662476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:05.663222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:05.670025 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:05.670478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:05.671315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:05.671753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:05.741020 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2c533654-4840-4b26-af65-72d3c6cc235d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:05.743048 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2c533654-4840-4b26-af65-72d3c6cc235d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:05.750147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c533654-4840-4b26-af65-72d3c6cc235d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:05.750600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c533654-4840-4b26-af65-72d3c6cc235d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:05.751429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c533654-4840-4b26-af65-72d3c6cc235d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:05.751868 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2c533654-4840-4b26-af65-72d3c6cc235d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:05.806234 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:05.814690 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:05.816280 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:05.817990 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-94ca0ef4-9cca-4edd-9a19-927d383e88a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1717 microversion: 2.20 time: 0.159736 Jan 27 16:13:05.818556 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 657/1316] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:05 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:05.820189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2c533654-4840-4b26-af65-72d3c6cc235d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.083021 Jan 27 16:13:05.821006 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 660/1317] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:05 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:13:06.832854 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8a3c043f-cdab-4c61-9a0d-1dfc8b1019a8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:06.833857 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8a3c043f-cdab-4c61-9a0d-1dfc8b1019a8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:06.839806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:06.840703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:06.840894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a3c043f-cdab-4c61-9a0d-1dfc8b1019a8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:06.841113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a3c043f-cdab-4c61-9a0d-1dfc8b1019a8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:06.841763 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a3c043f-cdab-4c61-9a0d-1dfc8b1019a8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:06.842194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a3c043f-cdab-4c61-9a0d-1dfc8b1019a8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:06.849379 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:06.849870 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:06.850956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:06.851764 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:06.907392 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8a3c043f-cdab-4c61-9a0d-1dfc8b1019a8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.079047 Jan 27 16:13:06.908076 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 658/1318] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:06 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:07.015517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:07.028782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:07.030330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:07.031564 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e531d060-7715-4e2f-92d6-d116fd2a6edd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1717 microversion: 2.20 time: 0.198026 Jan 27 16:13:07.038133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 661/1319] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:06 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1717 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:07.614262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-5bf71cc8-c19c-4d88-98ea-630da00d3f8a req-3c4989c5-7f00-4eb1-acbe-98683d84a307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2a1a78-ef34-45bd-ac94-52a498c00afc", "name": "network-vif-unplugged", "status": "completed", "tag": "65f08781-43d4-4145-addc-4b4981e01510"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:07.615852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:13:07.615852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:13:07.623808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-5bf71cc8-c19c-4d88-98ea-630da00d3f8a req-3c4989c5-7f00-4eb1-acbe-98683d84a307 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:07.624260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-5bf71cc8-c19c-4d88-98ea-630da00d3f8a req-3c4989c5-7f00-4eb1-acbe-98683d84a307 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:07.636524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.compute.server_external_events [req-5bf71cc8-c19c-4d88-98ea-630da00d3f8a req-3c4989c5-7f00-4eb1-acbe-98683d84a307 service nova] Unable to find a host for instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc. Dropping event network-vif-unplugged {{(pid=116260) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 27 16:13:07.637400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-5bf71cc8-c19c-4d88-98ea-630da00d3f8a req-3c4989c5-7f00-4eb1-acbe-98683d84a307 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027854 Jan 27 16:13:07.637981 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 659/1320] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 27 16:13:07.919568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-53689010-7999-444e-99ce-0d6b5cd39487 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:07.920390 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-53689010-7999-444e-99ce-0d6b5cd39487 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:07.927272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53689010-7999-444e-99ce-0d6b5cd39487 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:07.927723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53689010-7999-444e-99ce-0d6b5cd39487 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:07.928499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53689010-7999-444e-99ce-0d6b5cd39487 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:07.928933 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-53689010-7999-444e-99ce-0d6b5cd39487 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:07.995397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-53689010-7999-444e-99ce-0d6b5cd39487 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.079346 Jan 27 16:13:07.996318 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 662/1321] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:07 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:13:08.052671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:08.053416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:08.060140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:08.060594 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:08.061398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:08.061832 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:08.207749 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:08.215952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:08.217617 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:08.218775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-47c645db-0854-41e1-b867-7b15ec7283d2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1660 microversion: 2.20 time: 0.170576 Jan 27 16:13:08.219388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 660/1322] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:08 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1660 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:08.237997 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2236a3ca-9779-4772-b5a4-ea653e8ecdf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0796eeae-a363-463a-927a-effec697cd3a"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:08.239171 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2236a3ca-9779-4772-b5a4-ea653e8ecdf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:08.246154 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2236a3ca-9779-4772-b5a4-ea653e8ecdf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:08.246637 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2236a3ca-9779-4772-b5a4-ea653e8ecdf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:08.247447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2236a3ca-9779-4772-b5a4-ea653e8ecdf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:08.247877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2236a3ca-9779-4772-b5a4-ea653e8ecdf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:08.532037 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2236a3ca-9779-4772-b5a4-ea653e8ecdf6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298151 Jan 27 16:13:08.536321 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 663/1323] 10.222.0.61 () {62 vars in 1363 bytes} [Thu Jan 27 16:13:08 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:08.676966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f8c872da-a132-40b9-af91-f96c6ca35c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:08.677792 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f8c872da-a132-40b9-af91-f96c6ca35c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:08.688660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8c872da-a132-40b9-af91-f96c6ca35c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:08.689228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8c872da-a132-40b9-af91-f96c6ca35c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:08.690337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8c872da-a132-40b9-af91-f96c6ca35c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:08.691040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f8c872da-a132-40b9-af91-f96c6ca35c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:08.940667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f8c872da-a132-40b9-af91-f96c6ca35c11 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-volume_attachments/0796eeae-a363-463a-927a-effec697cd3a" status: 202 len: 0 microversion: 2.20 time: 0.271014 Jan 27 16:13:08.941419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 661/1324] 10.222.0.61 () {60 vars in 1456 bytes} [Thu Jan 27 16:13:08 2022] DELETE /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-volume_attachments/0796eeae-a363-463a-927a-effec697cd3a => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:13:09.000754 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-68b30c52-4067-4fda-a9e2-f46d8ca9a6a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:09.001609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-68b30c52-4067-4fda-a9e2-f46d8ca9a6a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:09.007826 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1dd47592-7790-46cd-b30a-a2b7e6aac514 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:09.009993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b30c52-4067-4fda-a9e2-f46d8ca9a6a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:09.010185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1dd47592-7790-46cd-b30a-a2b7e6aac514 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:09.010563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b30c52-4067-4fda-a9e2-f46d8ca9a6a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:09.011602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b30c52-4067-4fda-a9e2-f46d8ca9a6a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:09.012092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68b30c52-4067-4fda-a9e2-f46d8ca9a6a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:09.022938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dd47592-7790-46cd-b30a-a2b7e6aac514 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:09.023414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dd47592-7790-46cd-b30a-a2b7e6aac514 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:09.024217 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dd47592-7790-46cd-b30a-a2b7e6aac514 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:09.024652 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1dd47592-7790-46cd-b30a-a2b7e6aac514 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:09.091673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1dd47592-7790-46cd-b30a-a2b7e6aac514 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28647 microversion: 2.1 time: 0.087250 Jan 27 16:13:09.093251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 662/1325] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:09 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28647 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:13:09.099586 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-68b30c52-4067-4fda-a9e2-f46d8ca9a6a3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action" status: 202 len: 0 microversion: 2.20 time: 0.102592 Jan 27 16:13:09.100525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 664/1326] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jan 27 16:13:08 2022] POST /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:13:09.111092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:09.111978 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:09.121282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:09.121928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:09.123139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:09.124164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:09.328301 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:09.341858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:09.344950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:09.346966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4f9bea86-a26b-4584-bb68-f77569a6b9f4 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1668 microversion: 2.20 time: 0.240207 Jan 27 16:13:09.348050 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 663/1327] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:09 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:10.106846 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6359eace-0cff-4564-9f57-e0b7c72f1df2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:10.107885 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6359eace-0cff-4564-9f57-e0b7c72f1df2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:10.115022 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6359eace-0cff-4564-9f57-e0b7c72f1df2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:10.115474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6359eace-0cff-4564-9f57-e0b7c72f1df2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:10.116276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6359eace-0cff-4564-9f57-e0b7c72f1df2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:10.116707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6359eace-0cff-4564-9f57-e0b7c72f1df2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:10.200078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6359eace-0cff-4564-9f57-e0b7c72f1df2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 28999 microversion: 2.1 time: 0.097068 Jan 27 16:13:10.201656 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 665/1328] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:10 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 28999 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:10.377131 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:10.378162 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:10.386474 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:10.387113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:10.388194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:10.388739 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:10.720663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:10.729998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:10.731818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:10.733558 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ea267b31-1364-4631-82bb-262ff6f13775 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.360894 Jan 27 16:13:10.734296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 664/1329] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:10 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:11.215552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-26544676-0800-435b-95c8-f96517cffb8a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:11.216605 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-26544676-0800-435b-95c8-f96517cffb8a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:11.224668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26544676-0800-435b-95c8-f96517cffb8a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:11.225552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26544676-0800-435b-95c8-f96517cffb8a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:11.226402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26544676-0800-435b-95c8-f96517cffb8a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:11.226877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26544676-0800-435b-95c8-f96517cffb8a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:11.327629 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-26544676-0800-435b-95c8-f96517cffb8a tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 30955 microversion: 2.1 time: 0.116085 Jan 27 16:13:11.328463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 666/1330] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:11 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 30955 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:13:11.754418 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:11.755199 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:11.763542 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:11.764678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:11.770675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:11.771547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:11.960599 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:11.973624 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:11.976132 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:11.977718 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1fb3573c-dd9c-4b8d-b54f-14776af47256 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.227602 Jan 27 16:13:11.978914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 665/1331] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:11 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:12.344945 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-21eed934-8e41-4040-bbcd-d64835097387 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:12.346119 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-21eed934-8e41-4040-bbcd-d64835097387 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:12.355085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21eed934-8e41-4040-bbcd-d64835097387 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:12.355809 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21eed934-8e41-4040-bbcd-d64835097387 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:12.356917 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21eed934-8e41-4040-bbcd-d64835097387 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:12.357372 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21eed934-8e41-4040-bbcd-d64835097387 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:13.004404 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:13:13.005063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:13:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc (ip 10.222.0.61) !!! Jan 27 16:13:13.008280 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:13.009381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:13.017986 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:13.018441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:13.019808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:13.020248 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:13.196543 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:13.216514 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:13.218129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:13.219428 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c2bcdff9-c1c5-4589-b438-06209b1e727a tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.218252 Jan 27 16:13:13.227251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 666/1332] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:12 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:14.237907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:14.238613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:14.245633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:14.246083 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:14.246900 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:14.247363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:14.413659 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:14.429194 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:14.432505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:14.434940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2f7949a6-7546-44e7-b301-bdc864512ad2 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.200333 Jan 27 16:13:14.438764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 667/1333] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:14 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:15.463328 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:15.463996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:15.470390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:15.470807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:15.471645 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:15.472611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:15.609303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:15.618040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:15.619563 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:15.620714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a5ea1a70-6deb-4284-b09e-e39ac1c824c6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.161119 Jan 27 16:13:15.621490 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 668/1334] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:15 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:16.640291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:16.641058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:16.648355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:16.648808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:16.649766 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:16.650367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:16.791105 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:16.799380 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:16.801468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:16.802779 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b0eba8a3-9dcb-464b-bbb4-b34a3aae48a6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.167018 Jan 27 16:13:16.803584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 669/1335] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:16 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:17.822560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:17.823570 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:17.832120 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:17.832882 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:17.834277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:17.835294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:17.994360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:18.004427 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:18.005971 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:18.007288 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eb5ccd47-f0c7-4faa-bd4c-c2c25592acc7 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.189355 Jan 27 16:13:18.007858 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 670/1336] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:17 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:19.030207 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:19.031487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:19.042945 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:19.043785 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:19.045232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:19.046029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:19.209477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:19.224956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:19.227975 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:19.230146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-84e0c1e3-77fc-44a4-9983-a4b1bd098841 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.206840 Jan 27 16:13:19.231335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 671/1337] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:19 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:20.258614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:20.259468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:20.266449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:20.266889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:20.267698 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:20.268208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:20.459144 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:20.474936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:20.477881 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:20.479946 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d55f20ea-be9d-4ca5-b8dc-5a137990bddf tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.224824 Jan 27 16:13:20.481419 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 672/1338] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:20 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:21.499750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:21.500585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:21.507042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:21.507493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:21.508290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:21.508724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:21.651555 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:21.659972 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:21.661496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:21.662639 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7b93d070-50b0-4d40-a177-7b945809de1c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.166681 Jan 27 16:13:21.663233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 673/1339] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:21 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:22.682151 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:22.683022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:22.690129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:22.691219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:22.692139 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:22.692664 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:22.841178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:22.856202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:22.859101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:22.861148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-197969c8-99f0-4ccc-a048-0e929fd6c47f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.183034 Jan 27 16:13:22.862693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 674/1340] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:22 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:23.881763 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:23.882497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:23.889676 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:23.890182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:23.890996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:23.891442 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:24.037529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:24.046482 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:24.048041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:24.049218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f60f30d9-451e-438d-9801-f520ebaa6ec6 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.172311 Jan 27 16:13:24.050298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 675/1341] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:23 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:24.512938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-21eed934-8e41-4040-bbcd-d64835097387 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action" status: 200 len: 38300 microversion: 2.1 time: 12.174775 Jan 27 16:13:24.513588 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 667/1342] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:13:12 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/action => generated 38300 bytes in 12177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:13:24.523660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ba35d06b-35e8-494b-83d3-84bb98c43273 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:24.524155 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ba35d06b-35e8-494b-83d3-84bb98c43273 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:24.532366 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ba35d06b-35e8-494b-83d3-84bb98c43273 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:24.533353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ba35d06b-35e8-494b-83d3-84bb98c43273 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:24.535359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ba35d06b-35e8-494b-83d3-84bb98c43273 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:24.535838 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ba35d06b-35e8-494b-83d3-84bb98c43273 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:24.572022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ba35d06b-35e8-494b-83d3-84bb98c43273 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/ips" status: 200 len: 144 microversion: 2.1 time: 0.051796 Jan 27 16:13:24.572850 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 676/1343] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jan 27 16:13:24 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/ips => generated 144 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:25.069609 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:25.070367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:25.078264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:25.078707 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:25.079555 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:25.079986 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:25.243607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:25.254802 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:25.256404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:25.257599 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7ba2fbda-5c15-49f3-86c6-2a6a0e1e631f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.193052 Jan 27 16:13:25.258155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 668/1344] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:25 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:25.945614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ad2c1b66-cd94-4818-89e9-943fff1133f0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1be95325-916b-49b9-85e3-1d6ddd5b89d6"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:25.946856 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ad2c1b66-cd94-4818-89e9-943fff1133f0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:25.953291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad2c1b66-cd94-4818-89e9-943fff1133f0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:25.953771 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad2c1b66-cd94-4818-89e9-943fff1133f0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:25.954524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad2c1b66-cd94-4818-89e9-943fff1133f0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:25.954950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad2c1b66-cd94-4818-89e9-943fff1133f0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:26.211872 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ad2c1b66-cd94-4818-89e9-943fff1133f0 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269809 Jan 27 16:13:26.213009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 677/1345] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:13:25 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:26.276635 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:26.277279 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:26.285107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:26.285847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:26.286382 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:26.287000 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:26.435264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:26.443698 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:26.445211 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:26.446432 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9771dfa3-cc0f-4559-b0d1-4b2faa33792d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.173736 Jan 27 16:13:26.447012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 669/1346] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:26 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:27.466320 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:27.467037 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:27.474152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:27.474600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:27.475417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:27.475853 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:27.636304 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:27.647510 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:27.649918 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:27.651741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-27bb6120-0309-40f8-bb97-0245a63ef3b9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.189869 Jan 27 16:13:27.652654 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 678/1347] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:27 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:28.672258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:28.672968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:28.683092 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:28.683794 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:28.685093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:28.685862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:28.847397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:28.860910 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:28.864278 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:28.870627 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-67ac61f0-542a-43b2-9a1d-1ba99477221f tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.200684 Jan 27 16:13:28.871303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 670/1348] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:28 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:13:29.890085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:29.890691 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:29.891981 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-23c92c8c-acfa-42ec-9612-0f4abd2e8c71 req-57f9451e-60db-4636-b67b-d14c47b4a82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2a1a78-ef34-45bd-ac94-52a498c00afc", "name": "network-vif-plugged", "status": "completed", "tag": "65f08781-43d4-4145-addc-4b4981e01510"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:29.895257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:13:29.895257 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:13:29.897767 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:29.898527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:29.899613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:29.900203 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:29.905001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-23c92c8c-acfa-42ec-9612-0f4abd2e8c71 req-57f9451e-60db-4636-b67b-d14c47b4a82f service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:29.905444 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-23c92c8c-acfa-42ec-9612-0f4abd2e8c71 req-57f9451e-60db-4636-b67b-d14c47b4a82f service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:29.917020 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-23c92c8c-acfa-42ec-9612-0f4abd2e8c71 req-57f9451e-60db-4636-b67b-d14c47b4a82f service nova] Creating event network-vif-plugged:65f08781-43d4-4145-addc-4b4981e01510 for instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc on hv-cinder-82635 Jan 27 16:13:29.922166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-23c92c8c-acfa-42ec-9612-0f4abd2e8c71 req-57f9451e-60db-4636-b67b-d14c47b4a82f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035307 Jan 27 16:13:29.922809 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 671/1349] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:30.050085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:30.059899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:30.061846 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:30.063238 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c9431304-0758-4c80-88fc-cc2b6217ea12 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.177673 Jan 27 16:13:30.064235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 679/1350] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:29 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:31.088960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:31.089644 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:31.096496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:31.096965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:31.097766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:31.098192 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:31.235361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:31.246703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:31.248775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:31.250189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4f7399c6-ecdc-4727-ad62-29de083a25d5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.165957 Jan 27 16:13:31.251173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 672/1351] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:31 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:32.269551 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:32.270137 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:32.276498 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:32.276948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:32.277730 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:32.278164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:32.407031 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:32.415957 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:32.417482 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:32.418641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8a49619a-a56d-4b11-ad76-1c29c7096bd5 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1726 microversion: 2.20 time: 0.152799 Jan 27 16:13:32.419300 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 680/1352] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:32 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:33.437412 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:33.438018 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:33.445704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:33.446399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:33.447621 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:33.448094 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:33.581064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:33.589854 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:33.591341 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:13:33.592575 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a8b0c459-1e02-49f0-8c11-6cec53dbf87d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1713 microversion: 2.20 time: 0.158847 Jan 27 16:13:33.593146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 673/1353] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:13:33 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:13:33.721954 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-93ab9634-3b65-4c4d-9cf8-d689e1699c60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:33.722953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-93ab9634-3b65-4c4d-9cf8-d689e1699c60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:33.729703 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-93ab9634-3b65-4c4d-9cf8-d689e1699c60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:33.730159 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-93ab9634-3b65-4c4d-9cf8-d689e1699c60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:33.730953 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-93ab9634-3b65-4c4d-9cf8-d689e1699c60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:33.731417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-93ab9634-3b65-4c4d-9cf8-d689e1699c60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:33.759944 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-93ab9634-3b65-4c4d-9cf8-d689e1699c60 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Jan 27 16:13:33.760497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 681/1354] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:13:33 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:33.770600 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ea3f9f36-3e8b-4ce0-b796-49df7e0d16d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:33.771137 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ea3f9f36-3e8b-4ce0-b796-49df7e0d16d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:33.777100 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea3f9f36-3e8b-4ce0-b796-49df7e0d16d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:33.777555 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea3f9f36-3e8b-4ce0-b796-49df7e0d16d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:33.778336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea3f9f36-3e8b-4ce0-b796-49df7e0d16d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:33.778776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ea3f9f36-3e8b-4ce0-b796-49df7e0d16d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:33.807840 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ea3f9f36-3e8b-4ce0-b796-49df7e0d16d2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/1be95325-916b-49b9-85e3-1d6ddd5b89d6" status: 200 len: 194 microversion: 2.1 time: 0.041420 Jan 27 16:13:33.808424 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 674/1355] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Jan 27 16:13:33 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/1be95325-916b-49b9-85e3-1d6ddd5b89d6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:35.127439 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3fbbbe6b-d9cc-44b4-bb1b-833cfbdee957 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c94430-680c-4d1d-8881-8cba8c6a6ce7"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:13:35.128486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3fbbbe6b-d9cc-44b4-bb1b-833cfbdee957 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:35.135698 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fbbbe6b-d9cc-44b4-bb1b-833cfbdee957 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:35.136146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fbbbe6b-d9cc-44b4-bb1b-833cfbdee957 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:35.136936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fbbbe6b-d9cc-44b4-bb1b-833cfbdee957 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:35.137368 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3fbbbe6b-d9cc-44b4-bb1b-833cfbdee957 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:35.370363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3fbbbe6b-d9cc-44b4-bb1b-833cfbdee957 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247115 Jan 27 16:13:35.371017 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 682/1356] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:13:35 2022] POST /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:42.859994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-262c4821-53c8-4c23-b5d7-abd109aa7648 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:42.860937 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-262c4821-53c8-4c23-b5d7-abd109aa7648 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:42.867281 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-262c4821-53c8-4c23-b5d7-abd109aa7648 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:42.867724 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-262c4821-53c8-4c23-b5d7-abd109aa7648 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:42.868496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-262c4821-53c8-4c23-b5d7-abd109aa7648 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:42.868927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-262c4821-53c8-4c23-b5d7-abd109aa7648 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:42.900372 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-262c4821-53c8-4c23-b5d7-abd109aa7648 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044082 Jan 27 16:13:42.900964 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 675/1357] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:13:42 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:13:58.453686 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ad69c02d-4aef-4892-83a3-996edc5461c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:58.454285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ad69c02d-4aef-4892-83a3-996edc5461c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:58.460568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad69c02d-4aef-4892-83a3-996edc5461c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:58.461019 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad69c02d-4aef-4892-83a3-996edc5461c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:58.461811 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad69c02d-4aef-4892-83a3-996edc5461c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:58.462249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ad69c02d-4aef-4892-83a3-996edc5461c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:58.491695 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ad69c02d-4aef-4892-83a3-996edc5461c8 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/1be95325-916b-49b9-85e3-1d6ddd5b89d6" status: 200 len: 194 microversion: 2.1 time: 0.043675 Jan 27 16:13:58.492298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 683/1358] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Jan 27 16:13:58 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/1be95325-916b-49b9-85e3-1d6ddd5b89d6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:58.502225 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:58.502767 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:58.509003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:58.509447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:58.510246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:58.510675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:58.587799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lazy-loading 'services' on Instance uuid 371f3393-3721-4edf-b044-c77a76c684fc {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:13:58.655458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-68d9c7bc-869e-4f40-b752-0394fe711bf4 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/1be95325-916b-49b9-85e3-1d6ddd5b89d6" status: 202 len: 0 microversion: 2.1 time: 0.157337 Jan 27 16:13:58.656045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 676/1359] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:13:58 2022] DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/1be95325-916b-49b9-85e3-1d6ddd5b89d6 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:13:59.766444 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c1176424-865e-413b-b6fb-046e6f326050 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:59.767109 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c1176424-865e-413b-b6fb-046e6f326050 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:59.773300 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1176424-865e-413b-b6fb-046e6f326050 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:59.773753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1176424-865e-413b-b6fb-046e6f326050 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:59.774751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1176424-865e-413b-b6fb-046e6f326050 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:59.775214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c1176424-865e-413b-b6fb-046e6f326050 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:59.804895 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c1176424-865e-413b-b6fb-046e6f326050 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/31c94430-680c-4d1d-8881-8cba8c6a6ce7" status: 200 len: 194 microversion: 2.1 time: 0.042883 Jan 27 16:13:59.805395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 684/1360] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Jan 27 16:13:59 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/31c94430-680c-4d1d-8881-8cba8c6a6ce7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:13:59.816617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:13:59.817193 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:13:59.823188 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:59.823634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:59.824397 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:13:59.824826 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:13:59.902233 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lazy-loading 'services' on Instance uuid 371f3393-3721-4edf-b044-c77a76c684fc {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:13:59.971510 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-bfb7b7ed-8628-4ed4-9783-f76e13786bac tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/31c94430-680c-4d1d-8881-8cba8c6a6ce7" status: 202 len: 0 microversion: 2.1 time: 0.159813 Jan 27 16:13:59.972128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 677/1361] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:13:59 2022] DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments/31c94430-680c-4d1d-8881-8cba8c6a6ce7 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:14:01.121051 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c2585ba3-212f-4350-ab27-02b75d0fc7ae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:01.122016 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c2585ba3-212f-4350-ab27-02b75d0fc7ae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:01.128871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2585ba3-212f-4350-ab27-02b75d0fc7ae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.129325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2585ba3-212f-4350-ab27-02b75d0fc7ae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.130099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2585ba3-212f-4350-ab27-02b75d0fc7ae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.130536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c2585ba3-212f-4350-ab27-02b75d0fc7ae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.159203 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c2585ba3-212f-4350-ab27-02b75d0fc7ae tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041800 Jan 27 16:14:01.159791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 685/1362] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:14:01 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:14:01.260571 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-43a5f582-36ef-4c76-b9d1-861583e820a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:01.261654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-43a5f582-36ef-4c76-b9d1-861583e820a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:01.268919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43a5f582-36ef-4c76-b9d1-861583e820a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.269377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43a5f582-36ef-4c76-b9d1-861583e820a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.270185 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43a5f582-36ef-4c76-b9d1-861583e820a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.270628 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-43a5f582-36ef-4c76-b9d1-861583e820a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.302064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-43a5f582-36ef-4c76-b9d1-861583e820a2 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046112 Jan 27 16:14:01.302521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 678/1363] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:14:01 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:14:01.359154 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:01.359650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:01.365563 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.366012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.366794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.367260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.392192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:14:01.468679 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-50cfd040-11f7-4dee-bd43-7db116d66298 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 204 len: 0 microversion: 2.1 time: 0.112925 Jan 27 16:14:01.469246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 686/1364] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:14:01 2022] DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:14:01.477618 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:01.478253 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:01.484728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.485170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.485941 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:01.486373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:01.615648 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:01.623381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-13123c00-8a36-4596-976b-7931d092cfe9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1671 microversion: 2.1 time: 0.149341 Jan 27 16:14:01.623959 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 679/1365] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:01 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:02.641906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:02.642611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:02.648951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:02.649410 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:02.650202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:02.650642 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:02.839633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:02.847880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-04084b5e-b78c-49bc-bbca-da00e33a2fc1 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1671 microversion: 2.1 time: 0.210651 Jan 27 16:14:02.848459 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 687/1366] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:02 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:03.864768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:03.865579 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:03.872041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:03.872581 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:03.873476 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:03.873922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:04.022554 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:04.030852 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-eee66086-573f-4e3d-9703-2e401bb4a9bc tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1671 microversion: 2.1 time: 0.169674 Jan 27 16:14:04.031488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 680/1367] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:03 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:04.869423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-aca0e0fb-03b9-4fc8-b195-c0d68c581778 req-3e471697-ada6-4780-8988-035dfaf268dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371f3393-3721-4edf-b044-c77a76c684fc", "name": "network-vif-deleted", "tag": "ff5d25f5-ce25-4922-b228-2e1623343a70"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:14:04.875880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:14:04.875880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:14:04.889347 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-aca0e0fb-03b9-4fc8-b195-c0d68c581778 req-3e471697-ada6-4780-8988-035dfaf268dd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:04.890044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-aca0e0fb-03b9-4fc8-b195-c0d68c581778 req-3e471697-ada6-4780-8988-035dfaf268dd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:04.911989 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-aca0e0fb-03b9-4fc8-b195-c0d68c581778 req-3e471697-ada6-4780-8988-035dfaf268dd service nova] Creating event network-vif-deleted:ff5d25f5-ce25-4922-b228-2e1623343a70 for instance 371f3393-3721-4edf-b044-c77a76c684fc on hv-cinder-82635 Jan 27 16:14:04.920019 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-aca0e0fb-03b9-4fc8-b195-c0d68c581778 req-3e471697-ada6-4780-8988-035dfaf268dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176698 Jan 27 16:14:04.929261 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 688/1368] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:14:05.053216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:05.054346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:05.066465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:05.068173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:05.069622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:05.070400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:05.109216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:05.109758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:05.110274 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lazy-loading 'fault' on Instance uuid 371f3393-3721-4edf-b044-c77a76c684fc {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:14:05.172983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ac7389bd7d48c7bdd305cb27558952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b245b789104749da9a1417bab1c186c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:05.181481 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-86b6be46-eb13-4611-96f6-b7782cbfc70d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 200 len: 1326 microversion: 2.1 time: 0.135837 Jan 27 16:14:05.182275 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 681/1369] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:05 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:06.205993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:06.206872 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:06.213693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:06.214227 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:06.215329 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:06.215874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:06.230666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] HTTP exception thrown: Instance 371f3393-3721-4edf-b044-c77a76c684fc could not be found. Jan 27 16:14:06.231296 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Returning 404 to user: Instance 371f3393-3721-4edf-b044-c77a76c684fc could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:06.232128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0e2668f9-1ca5-43b4-a7e1-6bd5c741c258 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 404 len: 111 microversion: 2.1 time: 0.030731 Jan 27 16:14:06.232710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 689/1370] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:06 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:14:06.245428 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-62782886-f62c-48a1-9baf-c1678b09281d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '.version_select at 0x7f7812983ca0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:06.252049 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62782886-f62c-48a1-9baf-c1678b09281d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [b7ddf720-17ae-4cd7-820c-8c058f2afe1b] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 27 16:14:07.261144 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [None req-62782886-f62c-48a1-9baf-c1678b09281d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [b7ddf720-17ae-4cd7-820c-8c058f2afe1b] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40570. Jan 27 16:14:07.282223 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-62782886-f62c-48a1-9baf-c1678b09281d tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323975625" status: 202 len: 0 microversion: 2.1 time: 1.043756 Jan 27 16:14:07.282799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 682/1371] 10.222.0.61 () {58 vars in 1217 bytes} [Thu Jan 27 16:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323975625 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:14:10.347904 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:10.348420 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:10.354891 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:10.355383 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:10.356179 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:10.356617 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:10.371178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] HTTP exception thrown: Instance 371f3393-3721-4edf-b044-c77a76c684fc could not be found. Jan 27 16:14:10.371800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Returning 404 to user: Instance 371f3393-3721-4edf-b044-c77a76c684fc could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:10.372625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7ee79234-462c-4696-8b44-3d975fc28b56 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 404 len: 111 microversion: 2.1 time: 0.028668 Jan 27 16:14:10.373262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 690/1372] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:14:10 2022] DELETE /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:14:10.381700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:10.382339 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 371f3393-3721-4edf-b044-c77a76c684fc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:10.389209 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:10.389662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:10.390450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:10.390887 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:10.404083 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] HTTP exception thrown: Instance 371f3393-3721-4edf-b044-c77a76c684fc could not be found. Jan 27 16:14:10.404680 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Returning 404 to user: Instance 371f3393-3721-4edf-b044-c77a76c684fc could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:10.406078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a83844c7-dbea-4812-af56-0d97fca42b78 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc" status: 404 len: 111 microversion: 2.1 time: 0.028688 Jan 27 16:14:10.406626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 683/1373] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:10 2022] GET /compute/v2.1/servers/371f3393-3721-4edf-b044-c77a76c684fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:14:11.545582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:11.546117 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:11.552576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:11.553021 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:11.553798 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:11.554236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:11.568122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] HTTP exception thrown: Instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 could not be found. Jan 27 16:14:11.568705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Returning 404 to user: Instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:11.569513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7ea28681-ac19-4309-b5c0-d0378819d506 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 404 len: 111 microversion: 2.1 time: 0.027612 Jan 27 16:14:11.570045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 691/1374] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:14:11 2022] DELETE /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:14:11.578293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:11.578899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] [instance: 3f3d80d1-f3b7-4435-853e-6c267367f0f9] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:11.585376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:11.585818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:11.586622 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:11.587081 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:11.600289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] HTTP exception thrown: Instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 could not be found. Jan 27 16:14:11.600865 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] Returning 404 to user: Instance 3f3d80d1-f3b7-4435-853e-6c267367f0f9 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:11.601669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1a88e3b2-6b8e-49cd-a5f4-4b3436a17ad9 tempest-AttachVolumeTestJSON-1478876334 tempest-AttachVolumeTestJSON-1478876334-project] 10.222.0.61 "GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9" status: 404 len: 111 microversion: 2.1 time: 0.027598 Jan 27 16:14:11.602194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 684/1375] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:11 2022] GET /compute/v2.1/servers/3f3d80d1-f3b7-4435-853e-6c267367f0f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:14:17.684364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f049d4cd-3a2e-472b-abcf-9e9d64846fdd tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f7812300310>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:17.738270 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f049d4cd-3a2e-472b-abcf-9e9d64846fdd tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c55d898a-13d9-4f97-aa0e-7bd3522f68f9" status: 200 len: 350 microversion: 2.1 time: 0.057842 Jan 27 16:14:17.738949 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 692/1376] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:14:17 2022] GET /compute/v2.1/os-volumes/c55d898a-13d9-4f97-aa0e-7bd3522f68f9 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:14:19.081259 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8f9dba28-de92-4227-9f32-6c389f21504c tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f7812af6670>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:19.133190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8f9dba28-de92-4227-9f32-6c389f21504c tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/788747b4-f41a-4116-a312-84eb42f25d15" status: 200 len: 351 microversion: 2.1 time: 0.055680 Jan 27 16:14:19.133896 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 685/1377] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:14:19 2022] GET /compute/v2.1/os-volumes/788747b4-f41a-4116-a312-84eb42f25d15 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:14:20.528362 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6833de6c-5006-4fd4-9ad9-f4f3f7ee0d5d tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f78122f19d0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:20.584712 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6833de6c-5006-4fd4-9ad9-f4f3f7ee0d5d tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/134dc2e8-7a57-49e0-9265-bba5e38d0f1e" status: 200 len: 349 microversion: 2.1 time: 0.064505 Jan 27 16:14:20.585279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 693/1378] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:14:20 2022] GET /compute/v2.1/os-volumes/134dc2e8-7a57-49e0-9265-bba5e38d0f1e => generated 349 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:14:20.597145 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-34d5afac-2d0d-4c32-bd40-d22755451c8f tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f781291d820>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:20.682798 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-34d5afac-2d0d-4c32-bd40-d22755451c8f tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089895 Jan 27 16:14:20.683405 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 686/1379] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Jan 27 16:14:20 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:14:20.696422 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8582c2f0-5427-4c0d-a61b-f9b5047c793d tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f7813c481f0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:20.781737 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8582c2f0-5427-4c0d-a61b-f9b5047c793d tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088712 Jan 27 16:14:20.782756 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 694/1380] 10.222.0.61 () {58 vars in 1148 bytes} [Thu Jan 27 16:14:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:14:20.799806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6329a776-46c7-49de-a525-54995bcfb139 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f78129e13a0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:20.885515 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6329a776-46c7-49de-a525-54995bcfb139 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089292 Jan 27 16:14:20.886106 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 687/1381] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Jan 27 16:14:20 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:20.898063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-54dd8126-4415-4f66-902a-0b6c7997b6ae tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f78123001f0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:20.978660 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-54dd8126-4415-4f66-902a-0b6c7997b6ae tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084210 Jan 27 16:14:20.979284 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 695/1382] 10.222.0.61 () {58 vars in 1166 bytes} [Thu Jan 27 16:14:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:14:20.996041 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-447be987-f58e-426c-83a4-f387d727f253 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f7812af63a0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:21.078303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-447be987-f58e-426c-83a4-f387d727f253 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085889 Jan 27 16:14:21.078877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 688/1383] 10.222.0.61 () {58 vars in 1169 bytes} [Thu Jan 27 16:14:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:14:21.090880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eefc4d33-7468-4536-9af5-f708368c09e7 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f7812310280>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:21.215732 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eefc4d33-7468-4536-9af5-f708368c09e7 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.128777 Jan 27 16:14:21.216309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 696/1384] 10.222.0.61 () {58 vars in 1154 bytes} [Thu Jan 27 16:14:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:21.227582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d2b27264-636e-4cfa-995d-51ef9802a98d tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f7812983a60>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:21.377307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d2b27264-636e-4cfa-995d-51ef9802a98d tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.153286 Jan 27 16:14:21.377994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 689/1385] 10.222.0.61 () {58 vars in 1187 bytes} [Thu Jan 27 16:14:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:14:21.391869 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f34a405d-4edf-44d4-967b-1029949c4cc2 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] Calling method '.version_select at 0x7f78122813a0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:21.484143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f34a405d-4edf-44d4-967b-1029949c4cc2 tempest-VolumesTestJSON-1239013447 tempest-VolumesTestJSON-1239013447-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.096921 Jan 27 16:14:21.485024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 697/1386] 10.222.0.61 () {58 vars in 1154 bytes} [Thu Jan 27 16:14:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:30.630116 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-67d91456-ba6a-4ce7-a70f-a63f79449862 req-aa5b69b6-f5dd-49af-b9d2-617786da3db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325464d0-4037-487b-b9b3-c71fb19fb437", "tag": "ad7c7c1a-2840-4fc3-8560-37a45a3feea6"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:14:30.633486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:14:30.633486 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:14:30.635337 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:30.636353 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:30.647156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:30.647899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:30.648455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-67d91456-ba6a-4ce7-a70f-a63f79449862 req-aa5b69b6-f5dd-49af-b9d2-617786da3db1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:30.649462 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:30.649870 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-67d91456-ba6a-4ce7-a70f-a63f79449862 req-aa5b69b6-f5dd-49af-b9d2-617786da3db1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:30.650407 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:30.673009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-67d91456-ba6a-4ce7-a70f-a63f79449862 req-aa5b69b6-f5dd-49af-b9d2-617786da3db1 service nova] Creating event network-changed:ad7c7c1a-2840-4fc3-8560-37a45a3feea6 for instance 325464d0-4037-487b-b9b3-c71fb19fb437 on hv-cinder-82635 Jan 27 16:14:30.682753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-67d91456-ba6a-4ce7-a70f-a63f79449862 req-aa5b69b6-f5dd-49af-b9d2-617786da3db1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058897 Jan 27 16:14:30.690772 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 698/1387] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:14:30.702781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:14:30.859591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-61f0d301-29fe-49fe-87ca-233e532a550e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "DELETE /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 204 len: 0 microversion: 2.1 time: 0.241300 Jan 27 16:14:30.866913 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 690/1388] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:14:30 2022] DELETE /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:14:30.876597 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:30.878056 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:30.889822 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:30.890912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:30.892576 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:30.893547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:31.295590 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:31.319577 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-88116ce3-407d-44cb-be0a-fc1296c3e59f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1570 microversion: 2.1 time: 0.450563 Jan 27 16:14:31.321798 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 699/1389] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:30 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1570 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:32.349803 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:32.351400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:32.363480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:32.364893 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:32.366690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:32.367631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:32.551951 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:32.562030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7cea9800-94a9-421a-994e-e9a6eb2245cd tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1451 microversion: 2.1 time: 0.218814 Jan 27 16:14:32.562807 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 691/1390] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:32 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1451 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:33.368555 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-99ac4863-25e9-44bc-baf5-e39f22371402 req-aa32cd1d-4d9e-4031-b03d-69591f9205f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325464d0-4037-487b-b9b3-c71fb19fb437", "name": "network-vif-deleted", "tag": "ad7c7c1a-2840-4fc3-8560-37a45a3feea6"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:14:33.373121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:14:33.373121 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:14:33.385190 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-99ac4863-25e9-44bc-baf5-e39f22371402 req-aa32cd1d-4d9e-4031-b03d-69591f9205f5 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:33.386343 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-99ac4863-25e9-44bc-baf5-e39f22371402 req-aa32cd1d-4d9e-4031-b03d-69591f9205f5 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:33.401553 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-99ac4863-25e9-44bc-baf5-e39f22371402 req-aa32cd1d-4d9e-4031-b03d-69591f9205f5 service nova] Creating event network-vif-deleted:ad7c7c1a-2840-4fc3-8560-37a45a3feea6 for instance 325464d0-4037-487b-b9b3-c71fb19fb437 on hv-cinder-82635 Jan 27 16:14:33.408369 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-99ac4863-25e9-44bc-baf5-e39f22371402 req-aa32cd1d-4d9e-4031-b03d-69591f9205f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046199 Jan 27 16:14:33.409747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 700/1391] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:14:33.580828 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:33.581744 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:33.590035 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:33.590778 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:33.592054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:33.593372 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:33.712132 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a046e67fe14e47e6b1a0442abb7cb58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3096dd728a485190c1c92efa3850e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:33.729071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-21fc743b-7e41-4400-8ab3-2798426a35d6 tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 200 len: 1220 microversion: 2.1 time: 0.153616 Jan 27 16:14:33.730414 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 692/1392] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:33 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:14:34.758057 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:34.759374 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] [instance: 325464d0-4037-487b-b9b3-c71fb19fb437] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:34.769455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:34.770675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:34.771440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:34.772173 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:34.797555 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] HTTP exception thrown: Instance 325464d0-4037-487b-b9b3-c71fb19fb437 could not be found. Jan 27 16:14:34.798602 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Returning 404 to user: Instance 325464d0-4037-487b-b9b3-c71fb19fb437 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:34.800146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-24596f1e-1d73-49be-b3b2-cb724a61b23e tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437" status: 404 len: 111 microversion: 2.1 time: 0.050292 Jan 27 16:14:34.801126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 701/1393] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:14:34 2022] GET /compute/v2.1/servers/325464d0-4037-487b-b9b3-c71fb19fb437 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:14:35.006736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cca5b50e-711e-4a76-96f2-736f8b70de7f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] Calling method '.version_select at 0x7f7812b624c0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:35.035521 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cca5b50e-711e-4a76-96f2-736f8b70de7f tempest-TestShelveInstance-120385398 tempest-TestShelveInstance-120385398-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1848046509" status: 202 len: 0 microversion: 2.1 time: 0.033435 Jan 27 16:14:35.036507 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 693/1394] 10.222.0.61 () {58 vars in 1253 bytes} [Thu Jan 27 16:14:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1848046509 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:14:38.937115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-9cff8402-0150-4135-85d0-a6a692bf2da9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:38.938062 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-9cff8402-0150-4135-85d0-a6a692bf2da9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:38.945794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9cff8402-0150-4135-85d0-a6a692bf2da9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:38.946375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9cff8402-0150-4135-85d0-a6a692bf2da9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:38.947433 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9cff8402-0150-4135-85d0-a6a692bf2da9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:38.948002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-9cff8402-0150-4135-85d0-a6a692bf2da9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:38.981849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-9cff8402-0150-4135-85d0-a6a692bf2da9 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048641 Jan 27 16:14:38.982818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 702/1395] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Jan 27 16:14:38 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:14:39.054723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:39.055739 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:39.063758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:39.064204 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:39.065023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:39.065657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:39.097520 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:14:39.219841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8c887a43-3946-4577-922e-98170180d81d tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 204 len: 0 microversion: 2.20 time: 0.168532 Jan 27 16:14:39.224987 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 694/1396] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jan 27 16:14:39 2022] DELETE /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:14:39.229883 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:39.232232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:39.239696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:39.240848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:39.242292 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:39.243045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:39.545107 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:39.562170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:39.564467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:39.566043 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1106068e-d7c2-4b3d-8ada-adb0d0055a61 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.339993 Jan 27 16:14:39.567777 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 703/1397] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:14:39 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:14:40.591938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:40.593030 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:40.603114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:40.603922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:40.605886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:40.606659 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:40.852465 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:40.865243 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:40.867090 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:40.868700 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-516daf3f-4eea-44fd-8f44-47cf20b99bfd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.285394 Jan 27 16:14:40.874525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 695/1398] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:14:40 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:14:41.891453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:41.892440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:41.903519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:41.904322 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:41.905704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:41.906605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:42.583437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:42.594513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:42.597082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e42712b632b4a83848a75e00f258c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f6fa34c0ae441a8fcb708070986ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:14:42.598574 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-131d51e2-31e7-4f5b-bbbe-b4ee8fe8396c tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 200 len: 1719 microversion: 2.20 time: 0.714451 Jan 27 16:14:42.599764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 704/1399] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:14:41 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 1719 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:14:43.014258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-bd25b8d2-6960-4f3f-8748-cc44c69c3d60 req-0b651e63-9ef9-491a-bdf0-6fb5483354c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2a1a78-ef34-45bd-ac94-52a498c00afc", "name": "network-vif-deleted", "tag": "65f08781-43d4-4145-addc-4b4981e01510"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:14:43.042055 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:14:43.042055 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:14:43.094074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-bd25b8d2-6960-4f3f-8748-cc44c69c3d60 req-0b651e63-9ef9-491a-bdf0-6fb5483354c3 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:43.097639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-bd25b8d2-6960-4f3f-8748-cc44c69c3d60 req-0b651e63-9ef9-491a-bdf0-6fb5483354c3 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:43.132592 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-bd25b8d2-6960-4f3f-8748-cc44c69c3d60 req-0b651e63-9ef9-491a-bdf0-6fb5483354c3 service nova] Creating event network-vif-deleted:65f08781-43d4-4145-addc-4b4981e01510 for instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc on hv-cinder-82635 Jan 27 16:14:43.150325 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-bd25b8d2-6960-4f3f-8748-cc44c69c3d60 req-0b651e63-9ef9-491a-bdf0-6fb5483354c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143097 Jan 27 16:14:43.152670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 696/1400] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:14:43.625921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:43.630397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:43.657192 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:43.664821 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:43.668682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:43.669229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:43.708513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] HTTP exception thrown: Instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc could not be found. Jan 27 16:14:43.709137 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Returning 404 to user: Instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:43.710001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-45af0e87-4098-4a76-9e67-34fa4495546b tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 404 len: 111 microversion: 2.20 time: 0.092458 Jan 27 16:14:43.714558 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 705/1401] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:14:43 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:14:43.728806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-52d2fcea-04b5-4358-90ba-8f279b97b104 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '.version_select at 0x7f7812a6eee0>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:43.783573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-52d2fcea-04b5-4358-90ba-8f279b97b104 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-961076595" status: 204 len: 0 microversion: 2.20 time: 0.066633 Jan 27 16:14:43.784545 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 697/1402] 10.222.0.61 () {60 vars in 1258 bytes} [Thu Jan 27 16:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-961076595 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:14:46.643666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:46.644477 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:46.655562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:46.656353 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:46.657693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:46.658820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:46.690356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] HTTP exception thrown: Instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc could not be found. Jan 27 16:14:46.691356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Returning 404 to user: Instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:46.692768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3768c90b-93b0-4903-ae37-5138d66349bd tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 404 len: 111 microversion: 2.20 time: 0.055301 Jan 27 16:14:46.693897 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 706/1403] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jan 27 16:14:46 2022] DELETE /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:14:46.708265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:46.709680 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: 2f2a1a78-ef34-45bd-ac94-52a498c00afc] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:46.721367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:46.722567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:46.724389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:46.725229 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:46.749073 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] HTTP exception thrown: Instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc could not be found. Jan 27 16:14:46.750066 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Returning 404 to user: Instance 2f2a1a78-ef34-45bd-ac94-52a498c00afc could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:46.751690 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fb5799eb-fcf4-405b-98d7-99fe3c5bf36e tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc" status: 404 len: 111 microversion: 2.20 time: 0.050599 Jan 27 16:14:46.752890 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 698/1404] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:14:46 2022] GET /compute/v2.1/servers/2f2a1a78-ef34-45bd-ac94-52a498c00afc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:14:47.959651 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:47.960311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:47.967617 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:47.968063 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:47.968854 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:47.969283 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:47.983663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] HTTP exception thrown: Instance ffb168b3-a714-4f0b-aca9-d23922390178 could not be found. Jan 27 16:14:47.984251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Returning 404 to user: Instance ffb168b3-a714-4f0b-aca9-d23922390178 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:47.985074 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6b6d4e1d-5f96-4dbc-845a-581e2a4c0917 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 404 len: 111 microversion: 2.20 time: 0.029259 Jan 27 16:14:47.985622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 707/1405] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jan 27 16:14:47 2022] DELETE /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 27 16:14:47.993838 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:47.994670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] [instance: ffb168b3-a714-4f0b-aca9-d23922390178] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:14:48.001234 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:48.001671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:48.002461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:14:48.002881 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:14:48.017582 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] HTTP exception thrown: Instance ffb168b3-a714-4f0b-aca9-d23922390178 could not be found. Jan 27 16:14:48.018166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] Returning 404 to user: Instance ffb168b3-a714-4f0b-aca9-d23922390178 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:48.018999 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9dbd068c-3d1e-4c0d-abcd-c7c5305799e3 tempest-AttachVolumeShelveTestJSON-747386318 tempest-AttachVolumeShelveTestJSON-747386318-project] 10.222.0.61 "GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178" status: 404 len: 111 microversion: 2.20 time: 0.029161 Jan 27 16:14:48.019572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 699/1406] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jan 27 16:14:47 2022] GET /compute/v2.1/servers/ffb168b3-a714-4f0b-aca9-d23922390178 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:14:54.198572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-52f4c12d-f575-4ce3-9917-6fbce2e5714d tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Action: 'create', calling method: .version_select at 0x7f7812c20160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1359881062", "metadata": {"Type": "work"}}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:14:54.201022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-52f4c12d-f575-4ce3-9917-6fbce2e5714d tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:54.202179 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-52f4c12d-f575-4ce3-9917-6fbce2e5714d tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.171442 Jan 27 16:14:54.202874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 708/1407] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jan 27 16:14:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 27 16:14:54.213025 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-731d28a0-05e7-47a6-b23c-8087af3aa718 tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Action: 'create', calling method: .version_select at 0x7f7812ac1940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1269021354", "metadata": {"Type": "work"}}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:14:54.214663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-731d28a0-05e7-47a6-b23c-8087af3aa718 tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:54.216305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-731d28a0-05e7-47a6-b23c-8087af3aa718 tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006612 Jan 27 16:14:54.217058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 700/1408] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jan 27 16:14:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 27 16:14:54.227724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-97117652-226d-4bc4-91ed-929e3ce6785f tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Action: 'create', calling method: .version_select at 0x7f781234db80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1396719709", "metadata": {"Type": "work"}}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:14:54.229952 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-97117652-226d-4bc4-91ed-929e3ce6785f tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:54.230748 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-97117652-226d-4bc4-91ed-929e3ce6785f tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006850 Jan 27 16:14:54.231378 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 709/1409] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jan 27 16:14:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:14:54.243954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f8a51c58-ea4e-4e3f-892d-1e65b2980d5e tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Calling method '.version_select at 0x7f7812af6040>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:54.287426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-f8a51c58-ea4e-4e3f-892d-1e65b2980d5e tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] HTTP exception thrown: Volume tempest-invalid-941639993 could not be found. Jan 27 16:14:54.288409 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f8a51c58-ea4e-4e3f-892d-1e65b2980d5e tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Returning 404 to user: Volume tempest-invalid-941639993 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:54.289796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f8a51c58-ea4e-4e3f-892d-1e65b2980d5e tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-941639993" status: 404 len: 98 microversion: 2.1 time: 0.051672 Jan 27 16:14:54.290738 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 701/1410] 10.222.0.61 () {58 vars in 1214 bytes} [Thu Jan 27 16:14:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-941639993 => generated 98 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 27 16:14:54.304593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b7b6a1d9-2c22-445f-9674-981e99e67cea tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005805 Jan 27 16:14:54.305432 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 710/1411] 10.222.0.61 () {58 vars in 1139 bytes} [Thu Jan 27 16:14:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 27 16:14:54.317317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ab57028c-ed05-4894-8099-edcc2a51bb9b tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004111 Jan 27 16:14:54.318203 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 702/1412] 10.222.0.61 () {58 vars in 1136 bytes} [Thu Jan 27 16:14:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 27 16:14:54.331364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4bc40c2d-0c07-4818-94a3-e795f1e22a7f tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Calling method '.version_select at 0x7f7812c204c0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:54.367207 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-4bc40c2d-0c07-4818-94a3-e795f1e22a7f tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] HTTP exception thrown: Volume d6cb3c94-42f3-4951-99be-4836e5b9aee3 could not be found. Jan 27 16:14:54.368282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4bc40c2d-0c07-4818-94a3-e795f1e22a7f tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Returning 404 to user: Volume d6cb3c94-42f3-4951-99be-4836e5b9aee3 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:54.369731 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4bc40c2d-0c07-4818-94a3-e795f1e22a7f tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/d6cb3c94-42f3-4951-99be-4836e5b9aee3" status: 404 len: 109 microversion: 2.1 time: 0.042547 Jan 27 16:14:54.370720 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 711/1413] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jan 27 16:14:54 2022] DELETE /compute/v2.1/os-volumes/d6cb3c94-42f3-4951-99be-4836e5b9aee3 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:14:54.381035 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-35499f40-f629-4b32-8479-6de39bb6ce4b tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Calling method '.version_select at 0x7f7812a9f550>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:14:54.411323 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-35499f40-f629-4b32-8479-6de39bb6ce4b tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] HTTP exception thrown: Volume d8a7d5d1-3bef-48e8-b39e-28685f63fa12 could not be found. Jan 27 16:14:54.412024 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-35499f40-f629-4b32-8479-6de39bb6ce4b tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] Returning 404 to user: Volume d8a7d5d1-3bef-48e8-b39e-28685f63fa12 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:14:54.413142 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-35499f40-f629-4b32-8479-6de39bb6ce4b tempest-VolumesNegativeTest-862852490 tempest-VolumesNegativeTest-862852490-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d8a7d5d1-3bef-48e8-b39e-28685f63fa12" status: 404 len: 109 microversion: 2.1 time: 0.035724 Jan 27 16:14:54.413940 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 703/1414] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jan 27 16:14:54 2022] GET /compute/v2.1/os-volumes/d8a7d5d1-3bef-48e8-b39e-28685f63fa12 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:15:10.889164 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-4162407", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "6486a01e-36d0-43f9-a5e2-f79b12bfabf8"}]}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:10.964008 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] validate_networks() for [('6486a01e-36d0-43f9-a5e2-f79b12bfabf8', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:15:11.803150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:15:11.803589 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:15:11.804080 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:15:11.804573 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:15:11.804916 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:15:11.821580 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:11.822324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:11.823677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:11.824378 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:11.855710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Getting quotas for project 37dcb2cdb17f4289b9e4ac65f1f865f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:15:11.861894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Getting quotas for user 99970f82759341bd8fc97360b47d9a3e and project 37dcb2cdb17f4289b9e4ac65f1f865f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:15:11.876372 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:15:11.881012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:15:11.947075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-dfc0f178-9e81-47d5-b1ff-adf3d6bc80ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065345 Jan 27 16:15:11.948873 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 712/1415] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:15:11.965603 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2d246301-0f3c-4677-a752-f66c5a4a8b8b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:11.967595 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d246301-0f3c-4677-a752-f66c5a4a8b8b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:12.086158 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2d246301-0f3c-4677-a752-f66c5a4a8b8b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:12.115109 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2d246301-0f3c-4677-a752-f66c5a4a8b8b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1211 microversion: 2.1 time: 0.152992 Jan 27 16:15:12.129169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 704/1416] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:11 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1211 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:13.164641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:13.169566 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:13.202937 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:13.203808 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:13.212565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:13.213363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:13.424206 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:13.446228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a6731bde-21b3-49d9-b59b-c718c64ec525 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1215 microversion: 2.1 time: 0.290504 Jan 27 16:15:13.459023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 713/1417] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:13 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1215 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:14.479066 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:14.480314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:14.489360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:14.489806 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:14.490845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:14.491539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:14.563946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:14.580816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a17f645a-4523-4761-a6aa-b4a0bf3fb613 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1269 microversion: 2.1 time: 0.107633 Jan 27 16:15:14.592146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 705/1418] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:14 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:15.123825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-17d7e5db-2429-40a0-b6f1-255dbb137fa1 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Action: 'create', calling method: .version_select at 0x7f7812284310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1991526380"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:15.154720 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-17d7e5db-2429-40a0-b6f1-255dbb137fa1 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for project fa3984d8f6dc40258844819aa562633f. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:15:15.159924 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-17d7e5db-2429-40a0-b6f1-255dbb137fa1 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for user 24f28c63ddb848b4b5e948bb30e4f6da and project fa3984d8f6dc40258844819aa562633f. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:15:15.543045 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-17d7e5db-2429-40a0-b6f1-255dbb137fa1 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for project fa3984d8f6dc40258844819aa562633f. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:15:15.547704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-17d7e5db-2429-40a0-b6f1-255dbb137fa1 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for user 24f28c63ddb848b4b5e948bb30e4f6da and project fa3984d8f6dc40258844819aa562633f. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:15:15.566040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-17d7e5db-2429-40a0-b6f1-255dbb137fa1 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.752764 Jan 27 16:15:15.573640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 714/1419] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Jan 27 16:15:14 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:15.606901 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:15.608653 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:15.625526 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:15.626463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:15.628111 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:15.629272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:15.911147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:15.919362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ebfce989-8e15-4433-9f64-df8defbaeadf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.322148 Jan 27 16:15:15.920213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 706/1420] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:15 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:16.509827 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-acf36d25-e107-4292-8263-3556517a7c39 req-ce8c2151-9941-493e-8e54-5367693cc701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55bc2ebf-679f-4d06-83d6-8b8edc21757f", "tag": "3eb9c15b-9c59-4828-91e8-d2993a816b72"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:16.515416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:15:16.515416 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:15:16.549221 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-acf36d25-e107-4292-8263-3556517a7c39 req-ce8c2151-9941-493e-8e54-5367693cc701 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:16.549890 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-acf36d25-e107-4292-8263-3556517a7c39 req-ce8c2151-9941-493e-8e54-5367693cc701 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:16.590532 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-acf36d25-e107-4292-8263-3556517a7c39 req-ce8c2151-9941-493e-8e54-5367693cc701 service nova] Creating event network-changed:3eb9c15b-9c59-4828-91e8-d2993a816b72 for instance 55bc2ebf-679f-4d06-83d6-8b8edc21757f on hv-cinder-82635 Jan 27 16:15:16.600221 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-acf36d25-e107-4292-8263-3556517a7c39 req-ce8c2151-9941-493e-8e54-5367693cc701 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097077 Jan 27 16:15:16.601723 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 715/1421] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:15:16.947190 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:16.948232 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:16.959052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:16.960416 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:16.962216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:16.962897 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:17.231583 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:17.242420 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-751fcd48-ff1b-4d9e-8b24-e280d03d802c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.300558 Jan 27 16:15:17.243299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 707/1422] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:16 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:18.261761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:18.262435 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:18.269358 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:18.269797 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:18.271064 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:18.271492 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:18.457251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:18.472092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1d1754f5-5db2-4083-9663-d0a57def2f37 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.214454 Jan 27 16:15:18.487957 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 716/1423] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:18 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:19.503660 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:19.505147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:19.515258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:19.519939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:19.519939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:19.519939 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:19.798742 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:19.813830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4fa36d11-44b8-4ca8-bb4b-cf6f83669c2f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.313898 Jan 27 16:15:19.815747 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 708/1424] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:19 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:20.838013 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:20.838823 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:20.846216 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:20.846646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:20.847701 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:20.848137 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:21.027527 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:21.042178 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7d0f21e4-b223-42f0-b5b0-033551b6c493 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.208182 Jan 27 16:15:21.043764 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 717/1425] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:20 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:22.068735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:22.069331 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:22.075908 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:22.076357 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:22.077246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:22.077736 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:22.281873 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:22.292497 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-d04a02fa-081e-41b3-b9fe-8d56d9ece221 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.227195 Jan 27 16:15:22.293333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 709/1426] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:22 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:23.311170 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:23.311761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:23.318710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:23.319196 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:23.319996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:23.320443 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:23.467803 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:23.475649 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-788de75f-f0c5-492e-b371-984fcd298498 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.168214 Jan 27 16:15:23.476588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 718/1427] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:23 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:24.497703 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:24.499054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:24.509035 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:24.509933 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:24.511020 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:24.511662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:24.544409 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-493bd806-d328-4f49-beab-0711bc0f41b4 req-e6053ec4-6ca5-4834-9d80-0e9db5737b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55bc2ebf-679f-4d06-83d6-8b8edc21757f", "name": "network-vif-plugged", "status": "completed", "tag": "3eb9c15b-9c59-4828-91e8-d2993a816b72"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:24.547474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:15:24.547474 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:15:24.561086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-493bd806-d328-4f49-beab-0711bc0f41b4 req-e6053ec4-6ca5-4834-9d80-0e9db5737b29 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:24.561861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-493bd806-d328-4f49-beab-0711bc0f41b4 req-e6053ec4-6ca5-4834-9d80-0e9db5737b29 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:24.584378 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-493bd806-d328-4f49-beab-0711bc0f41b4 req-e6053ec4-6ca5-4834-9d80-0e9db5737b29 service nova] Creating event network-vif-plugged:3eb9c15b-9c59-4828-91e8-d2993a816b72 for instance 55bc2ebf-679f-4d06-83d6-8b8edc21757f on hv-cinder-82635 Jan 27 16:15:24.595107 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-493bd806-d328-4f49-beab-0711bc0f41b4 req-e6053ec4-6ca5-4834-9d80-0e9db5737b29 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156377 Jan 27 16:15:24.597741 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 710/1428] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:15:24.710019 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:24.722235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-965282fc-2c10-42b4-8f86-d95594d6c725 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.229016 Jan 27 16:15:24.723328 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 719/1429] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:24 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:25.745464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:25.746219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:25.753188 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:25.753680 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:25.754759 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:25.755296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:25.914040 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:25.926156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0d44335e-3f2a-4291-b851-d8043f731098 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1311 microversion: 2.1 time: 0.184971 Jan 27 16:15:25.927140 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 711/1430] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:25 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1311 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:26.950388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:26.951222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:26.958363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:26.958862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:26.959725 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:26.960237 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:27.112912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:27.121171 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7f6e01be-d0b0-4038-86d4-f1aa1bc1b1a8 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1496 microversion: 2.1 time: 0.174400 Jan 27 16:15:27.121709 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 720/1431] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:26 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1496 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:27.629045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:27.629735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:27.637496 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:27.637954 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:27.638786 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:27.639683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:27.684391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:15:27.780534 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-32362655-2cc6-420f-b305-d80ab60a125a tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "DELETE /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 204 len: 0 microversion: 2.1 time: 0.155092 Jan 27 16:15:27.781306 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 712/1432] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:15:27 2022] DELETE /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:15:27.792535 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:27.793414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:27.799861 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:27.800390 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:27.801228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:27.801706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:27.945338 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:27.953115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-bf71a8ff-06f0-4463-8e90-eb9ee9b98a3d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1502 microversion: 2.1 time: 0.164981 Jan 27 16:15:27.953891 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 721/1433] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:27 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:28.981782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:28.982531 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:28.990341 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:28.990794 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:28.991647 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:28.992086 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:29.138272 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:29.146216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6ba53f55-2d43-4276-9279-4beabce7bbae tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1502 microversion: 2.1 time: 0.168893 Jan 27 16:15:29.146801 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 713/1434] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:28 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:30.144204 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-5fccc21f-6960-4f63-b93e-42996efb3cca req-6ba9c32a-27bb-4bc5-a009-81a120b6431c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55bc2ebf-679f-4d06-83d6-8b8edc21757f", "name": "network-vif-deleted", "tag": "3eb9c15b-9c59-4828-91e8-d2993a816b72"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:30.145836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:15:30.145836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:15:30.155972 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-5fccc21f-6960-4f63-b93e-42996efb3cca req-6ba9c32a-27bb-4bc5-a009-81a120b6431c service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:30.156754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-5fccc21f-6960-4f63-b93e-42996efb3cca req-6ba9c32a-27bb-4bc5-a009-81a120b6431c service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:30.165057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:30.165057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:30.172195 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:30.172777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:30.174367 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:30.174862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:30.181010 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-5fccc21f-6960-4f63-b93e-42996efb3cca req-6ba9c32a-27bb-4bc5-a009-81a120b6431c service nova] Creating event network-vif-deleted:3eb9c15b-9c59-4828-91e8-d2993a816b72 for instance 55bc2ebf-679f-4d06-83d6-8b8edc21757f on hv-cinder-82635 Jan 27 16:15:30.191297 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-5fccc21f-6960-4f63-b93e-42996efb3cca req-6ba9c32a-27bb-4bc5-a009-81a120b6431c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050113 Jan 27 16:15:30.192453 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 722/1435] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:15:30.276977 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:30.287384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7d00ca8f-0545-4a7e-a253-0289c1913fdd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 200 len: 1460 microversion: 2.1 time: 0.127229 Jan 27 16:15:30.288120 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 714/1436] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:30 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 1460 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:31.306622 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:31.307384 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: 55bc2ebf-679f-4d06-83d6-8b8edc21757f] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:31.314874 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:31.315367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:31.316202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:31.316649 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:31.335973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] HTTP exception thrown: Instance 55bc2ebf-679f-4d06-83d6-8b8edc21757f could not be found. Jan 27 16:15:31.336883 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Returning 404 to user: Instance 55bc2ebf-679f-4d06-83d6-8b8edc21757f could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:15:31.338182 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-39aa82fb-500f-43ec-ac85-adb6270d509b tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f" status: 404 len: 111 microversion: 2.1 time: 0.036088 Jan 27 16:15:31.339105 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 723/1437] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:31 2022] GET /compute/v2.1/servers/55bc2ebf-679f-4d06-83d6-8b8edc21757f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:15:31.427344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-539294395", "imageRef": "5a0ede56-0fc3-4dfb-9029-4ba466ec54cf", "flavorRef": "452", "networks": [{"uuid": "6486a01e-36d0-43f9-a5e2-f79b12bfabf8"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:31.491256 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] validate_networks() for [('6486a01e-36d0-43f9-a5e2-f79b12bfabf8', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:15:31.966140 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:15:31.966558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:15:31.967056 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:15:31.967461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:15:31.967864 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:15:31.977811 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:31.978299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:31.979207 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:31.979677 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:31.997401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Getting quotas for project 37dcb2cdb17f4289b9e4ac65f1f865f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:15:32.001687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Getting quotas for user 99970f82759341bd8fc97360b47d9a3e and project 37dcb2cdb17f4289b9e4ac65f1f865f6. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:15:32.013385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:15:32.015779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a0ede56-0fc3-4dfb-9029-4ba466ec54cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:15:32.065261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e1fcd254-dcbd-43d3-aba7-e75b29e5001c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641727 Jan 27 16:15:32.066235 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 715/1438] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:15:32.080276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4bd1432f-7404-4a47-bdc5-938552966229 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:32.081041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4bd1432f-7404-4a47-bdc5-938552966229 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:32.149623 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-4bd1432f-7404-4a47-bdc5-938552966229 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:32.157791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4bd1432f-7404-4a47-bdc5-938552966229 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1213 microversion: 2.1 time: 0.081724 Jan 27 16:15:32.159241 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 724/1439] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:32 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:33.183163 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:33.184319 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:33.196935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:33.197384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:33.198589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:33.199201 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:33.283360 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:33.292782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-30fb96e5-30b2-4079-9ef4-6a0b58fa9679 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1271 microversion: 2.1 time: 0.116503 Jan 27 16:15:33.293480 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 716/1440] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:33 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:34.313081 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:34.314052 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:34.321915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:34.322540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:34.323538 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:34.324152 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:34.586176 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:34.595699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1afc27be-c584-46b0-9abc-c251ab86b5bf tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.287573 Jan 27 16:15:34.596445 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 725/1441] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:34 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:34.661955 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-76d2fb76-ae67-4194-9ce6-e3348829d7b5 req-8d2d7285-91f5-474a-8f7b-231699cbc83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d221bb-ff51-40c8-993a-918e2427110a", "tag": "88082812-22a9-4b2a-9aa5-1ecefa25b039"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:34.665053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:15:34.665053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:15:34.676774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-76d2fb76-ae67-4194-9ce6-e3348829d7b5 req-8d2d7285-91f5-474a-8f7b-231699cbc83b service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:34.677170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-76d2fb76-ae67-4194-9ce6-e3348829d7b5 req-8d2d7285-91f5-474a-8f7b-231699cbc83b service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:34.700688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-76d2fb76-ae67-4194-9ce6-e3348829d7b5 req-8d2d7285-91f5-474a-8f7b-231699cbc83b service nova] Creating event network-changed:88082812-22a9-4b2a-9aa5-1ecefa25b039 for instance e4d221bb-ff51-40c8-993a-918e2427110a on hv-cinder-82635 Jan 27 16:15:34.706074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-76d2fb76-ae67-4194-9ce6-e3348829d7b5 req-8d2d7285-91f5-474a-8f7b-231699cbc83b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051595 Jan 27 16:15:34.706671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 717/1442] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:15:35.616892 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:35.617710 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:35.625306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:35.625762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:35.626592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:35.627607 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:35.807717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:35.815931 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-a8489810-dba3-4a08-a244-a518e9877587 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.203710 Jan 27 16:15:35.816512 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 726/1443] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:35 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:36.834768 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:36.835671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:36.844146 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:36.844774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:36.845737 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:36.846296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:37.010530 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:37.018542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-932bd0f3-5694-4899-9e06-da36d95bb1f7 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.189054 Jan 27 16:15:37.019194 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 718/1444] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:36 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:38.040328 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:38.041488 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:38.049639 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:38.050150 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:38.051276 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:38.051825 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:38.198133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:38.207141 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ffdd254f-0834-4f0d-a304-84310ee0e23e tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.173821 Jan 27 16:15:38.207741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 727/1445] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:38 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:39.232968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:39.233675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:39.240153 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:39.240601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:39.241399 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:39.241829 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:39.392221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:39.400877 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-ebc21f74-6f55-4211-aec3-e62265d462cd tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.171423 Jan 27 16:15:39.401649 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 719/1446] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:39 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:40.240636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1904437974", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1991526380", "security_groups": [{"name": "tempest-secgroup-smoke-721451781"}], "block_device_mapping_v2": [{"uuid": "c310b908-16c5-4aec-99a3-83701c256ee9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "44707522-96bc-4e9e-a009-bd6fc4ac0fe0"}]}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:40.399865 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] validate_networks() for [('44707522-96bc-4e9e-a009-bd6fc4ac0fe0', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:15:40.420468 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:40.421486 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:40.432903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:40.433633 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:40.435071 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:40.435737 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:40.632502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:40.640543 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b0e156fb-7707-4764-8dc1-ebc2fa6b1b5d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.226117 Jan 27 16:15:40.641148 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 720/1447] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:40 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:40.906133 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:15:40.906489 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:15:40.906962 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:15:40.907507 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:15:40.907940 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:15:40.917739 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:40.918282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:40.919148 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:40.919586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:40.937461 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for project fa3984d8f6dc40258844819aa562633f. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:15:40.943116 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for user 24f28c63ddb848b4b5e948bb30e4f6da and project fa3984d8f6dc40258844819aa562633f. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:15:41.017130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:15:41.020401 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c310b908-16c5-4aec-99a3-83701c256ee9',volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:15:41.196584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8e88b70a-6696-4600-b406-4bea59fc1275 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.961034 Jan 27 16:15:41.197668 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 728/1448] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:15:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:15:41.210892 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2bd668aa-272b-4f47-b187-33873528edbe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:41.211602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2bd668aa-272b-4f47-b187-33873528edbe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:41.276841 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2bd668aa-272b-4f47-b187-33873528edbe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:41.284893 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2bd668aa-272b-4f47-b187-33873528edbe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1095 microversion: 2.1 time: 0.077360 Jan 27 16:15:41.285596 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 721/1449] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:41 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:41.658784 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:41.660123 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:41.668584 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:41.669122 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:41.669950 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:41.670388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:41.850347 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:41.865377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d5d2f028-e8b3-4a9c-9456-d33dcf38b0ed tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.210128 Jan 27 16:15:41.867169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 729/1450] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:41 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:42.307095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:42.308159 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:42.314654 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:42.315145 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:42.316604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:42.317241 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:42.399596 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:42.410197 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2381b9db-3ab9-42a0-a399-17d88e8e2360 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1201 microversion: 2.1 time: 0.106719 Jan 27 16:15:42.411400 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 722/1451] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:42 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:42.585258 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-d89986ef-24a6-4ac2-b585-baf36b88cb4e req-4d81cbe2-caa0-4c21-8a26-c47efac07f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d221bb-ff51-40c8-993a-918e2427110a", "name": "network-vif-plugged", "status": "completed", "tag": "88082812-22a9-4b2a-9aa5-1ecefa25b039"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:42.586871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:15:42.586871 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:15:42.594705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-d89986ef-24a6-4ac2-b585-baf36b88cb4e req-4d81cbe2-caa0-4c21-8a26-c47efac07f4d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:42.595291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-d89986ef-24a6-4ac2-b585-baf36b88cb4e req-4d81cbe2-caa0-4c21-8a26-c47efac07f4d service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:42.610554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-d89986ef-24a6-4ac2-b585-baf36b88cb4e req-4d81cbe2-caa0-4c21-8a26-c47efac07f4d service nova] Creating event network-vif-plugged:88082812-22a9-4b2a-9aa5-1ecefa25b039 for instance e4d221bb-ff51-40c8-993a-918e2427110a on hv-cinder-82635 Jan 27 16:15:42.617159 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-d89986ef-24a6-4ac2-b585-baf36b88cb4e req-4d81cbe2-caa0-4c21-8a26-c47efac07f4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036027 Jan 27 16:15:42.618315 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 730/1452] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:15:42.891160 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:42.892410 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:42.902596 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:42.903387 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:42.904918 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:42.905634 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:43.101563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:43.116265 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-297414fb-65ff-487b-85c8-3a0792e7de1c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.230147 Jan 27 16:15:43.117344 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 723/1453] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:42 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:43.435423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:43.436140 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:43.442753 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:43.443293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:43.444086 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:43.444530 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:43.830031 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:43.838215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-356d5573-696f-4dc1-970c-ff54cc0473bc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.407983 Jan 27 16:15:43.838776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 731/1454] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:43 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:44.144821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:44.145889 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:44.154649 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:44.155126 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:44.155932 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:44.156364 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:44.317023 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-77b18eed-f5d9-49db-8f75-5735c940c1ae req-6394c235-fee6-4f24-8197-0679e0f7b950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e809722e-dbfd-42d6-8563-74ca78108388", "tag": "25797a64-6610-4c58-afb8-43ff88eb50f7"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:44.318762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:15:44.318762 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:15:44.351068 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-77b18eed-f5d9-49db-8f75-5735c940c1ae req-6394c235-fee6-4f24-8197-0679e0f7b950 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:44.351299 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-77b18eed-f5d9-49db-8f75-5735c940c1ae req-6394c235-fee6-4f24-8197-0679e0f7b950 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:44.402751 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-77b18eed-f5d9-49db-8f75-5735c940c1ae req-6394c235-fee6-4f24-8197-0679e0f7b950 service nova] Creating event network-changed:25797a64-6610-4c58-afb8-43ff88eb50f7 for instance e809722e-dbfd-42d6-8563-74ca78108388 on hv-cinder-82635 Jan 27 16:15:44.430209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-77b18eed-f5d9-49db-8f75-5735c940c1ae req-6394c235-fee6-4f24-8197-0679e0f7b950 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117646 Jan 27 16:15:44.432215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 732/1455] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:15:44.470970 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:44.488294 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1ac7ea3b-f239-4f2b-98b9-81ac3e57f94c tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1313 microversion: 2.1 time: 0.348312 Jan 27 16:15:44.498568 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 724/1456] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:44 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:44.865531 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:44.866704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:44.878038 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:44.878847 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:44.880298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:44.881101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:45.133215 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:45.147654 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6ed6e722-abcc-4ba7-826a-3f946fd5cb9a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.290718 Jan 27 16:15:45.148910 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 733/1457] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:44 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:45.506500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:45.507157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:45.513630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:45.514083 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:45.514903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:45.515435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:45.666607 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:45.674848 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f1d9c70c-bd07-40dd-a778-8c24951fc4e3 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1497 microversion: 2.1 time: 0.172890 Jan 27 16:15:45.675517 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 725/1458] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:45 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:46.131995 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:46.132583 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:46.138877 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:46.139355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:46.140137 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:46.140565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:46.168799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:15:46.173212 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:46.174217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:46.185387 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:46.186116 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:46.187558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:46.188330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:46.276836 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3e3d4f1e-3c55-4e27-8300-790b8e8a6870 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 204 len: 0 microversion: 2.1 time: 0.148156 Jan 27 16:15:46.277855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 734/1459] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:15:46 2022] DELETE /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:15:46.288641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:46.289340 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:46.296468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:46.296921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:46.297717 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:46.298272 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:46.362244 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:46.372825 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-869ce01d-b5f9-41ed-a2bb-cdd2da43fdbc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.203516 Jan 27 16:15:46.373659 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 726/1460] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:46 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:46.451614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:46.459932 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-305fe3d3-ae85-42e4-b7bf-15a5373cd48d tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1503 microversion: 2.1 time: 0.176630 Jan 27 16:15:46.460636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 735/1461] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:46 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:47.389667 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:47.390252 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:47.396715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:47.397162 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:47.397946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:47.398377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:47.477468 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:47.478128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:47.484993 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:47.485449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:47.486249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:47.486687 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:47.533513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:47.543583 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-347ff497-654f-4bec-9f20-085459f9ad18 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.157443 Jan 27 16:15:47.544800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 727/1462] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:47 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:47.620741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:47.628711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3d75e399-21cd-4047-bd31-b8b03d60622f tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1503 microversion: 2.1 time: 0.154784 Jan 27 16:15:47.629605 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 736/1463] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:47 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:48.373078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-ab37d13a-998d-4c68-826a-e089bfc3ce53 req-1902aa85-70f6-4655-9aaf-76b4715295bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d221bb-ff51-40c8-993a-918e2427110a", "name": "network-vif-deleted", "tag": "88082812-22a9-4b2a-9aa5-1ecefa25b039"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:15:48.374835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:15:48.374835 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:15:48.383535 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-ab37d13a-998d-4c68-826a-e089bfc3ce53 req-1902aa85-70f6-4655-9aaf-76b4715295bd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:48.383965 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-ab37d13a-998d-4c68-826a-e089bfc3ce53 req-1902aa85-70f6-4655-9aaf-76b4715295bd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:48.397381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-ab37d13a-998d-4c68-826a-e089bfc3ce53 req-1902aa85-70f6-4655-9aaf-76b4715295bd service nova] Creating event network-vif-deleted:88082812-22a9-4b2a-9aa5-1ecefa25b039 for instance e4d221bb-ff51-40c8-993a-918e2427110a on hv-cinder-82635 Jan 27 16:15:48.403411 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-ab37d13a-998d-4c68-826a-e089bfc3ce53 req-1902aa85-70f6-4655-9aaf-76b4715295bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033971 Jan 27 16:15:48.404034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 728/1464] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:15:48.564285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:48.564886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:48.572183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:48.572663 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:48.573470 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:48.573911 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:48.648371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:48.649061 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:48.655536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:48.655983 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:48.656781 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:48.657219 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:48.690787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:48.691293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:48.691742 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.objects.instance [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lazy-loading 'fault' on Instance uuid e4d221bb-ff51-40c8-993a-918e2427110a {{(pid=116261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:15:48.735129 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99970f82759341bd8fc97360b47d9a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37dcb2cdb17f4289b9e4ac65f1f865f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:48.747943 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-faeedb31-fe58-4b91-badc-885fc6eb7748 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 200 len: 1303 microversion: 2.1 time: 0.104171 Jan 27 16:15:48.750525 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 729/1465] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:48 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:48.764256 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:48.773859 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f6517f9b-3e1b-4951-8800-4ce26a952eea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.213324 Jan 27 16:15:48.774559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 737/1466] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:48 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:49.767932 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:49.768536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] [instance: e4d221bb-ff51-40c8-993a-918e2427110a] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:49.774811 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:49.775290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:49.776065 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:49.776493 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:49.790028 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] HTTP exception thrown: Instance e4d221bb-ff51-40c8-993a-918e2427110a could not be found. Jan 27 16:15:49.790612 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] Returning 404 to user: Instance e4d221bb-ff51-40c8-993a-918e2427110a could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:15:49.791040 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:49.791551 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-64683008-3106-4996-8174-c9261b72aa04 tempest-VolumesActionsTest-1823502867 tempest-VolumesActionsTest-1823502867-project] 10.222.0.61 "GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a" status: 404 len: 111 microversion: 2.1 time: 0.027221 Jan 27 16:15:49.791718 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:49.791975 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 730/1467] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:49 2022] GET /compute/v2.1/servers/e4d221bb-ff51-40c8-993a-918e2427110a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:15:49.798799 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:49.799279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:49.800066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:49.801003 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:49.956517 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:49.965678 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8d3ba5db-47ba-4403-a31a-523060efbaee tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.177916 Jan 27 16:15:49.966456 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 738/1468] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:49 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:15:50.983613 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:50.984250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:50.991133 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:50.991593 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:50.992413 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:50.992859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:51.137857 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:51.148415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-26b2f38d-463c-46bb-b0d8-cebe2aa1df0d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.168785 Jan 27 16:15:51.149098 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 731/1469] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:50 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:52.166059 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:52.166705 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:52.173222 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:52.173673 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:52.174549 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:52.175115 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:52.307090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:52.315376 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e17d8b2f-7c85-49a1-bb5b-731b092ce2ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.153101 Jan 27 16:15:52.316004 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 739/1470] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:52 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:53.331712 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:53.332429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:53.340348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:53.340348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:53.340981 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:53.341412 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:53.489993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:53.497657 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f9afbdc1-fdd4-4ab4-af64-c04ef0d85e7a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.169842 Jan 27 16:15:53.498242 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 732/1471] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:53 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:54.514649 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:54.515381 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:54.521973 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:54.522356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:54.523218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:54.523637 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:54.690134 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:54.698704 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-44fe3394-6f54-498d-89f8-d8ec48b4cf13 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.187620 Jan 27 16:15:54.699335 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 740/1472] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:54 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:55.718100 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:55.719019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:55.725212 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:55.725671 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:55.726450 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:55.726880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:55.878748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:55.886415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c3d958d6-7f7e-4e8f-9b8e-5f77005eb11d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.171902 Jan 27 16:15:55.887017 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 733/1473] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:55 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:56.906240 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:56.906788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:56.915885 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:56.916337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:56.917130 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:56.917921 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:57.097231 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:57.106907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-134aa68a-cde6-49ac-a3ff-b6691e80cfc4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.204398 Jan 27 16:15:57.107625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 741/1474] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:56 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:58.135327 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:58.136652 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:58.145290 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:58.146560 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:58.148169 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:58.148861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:58.326819 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:58.335946 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3868a6a7-62a7-46c2-9f79-58b5320f4f8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.204103 Jan 27 16:15:58.337216 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 734/1475] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:58 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:15:59.360845 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:15:59.362302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:15:59.369797 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:59.370667 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:59.371656 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:15:59.372323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:15:59.514828 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:15:59.524046 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-23fe798b-4cb0-4a66-9882-83c91efba35f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.168274 Jan 27 16:15:59.525614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 742/1476] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:15:59 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:00.541899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:00.543173 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:00.556384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:00.557150 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:00.558164 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:00.558849 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:00.628277 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-edbc28d4-31d9-49a7-8012-c826bfa2048b req-16432daf-b730-43b6-ab5e-ba49e3df39c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e809722e-dbfd-42d6-8563-74ca78108388", "name": "network-vif-plugged", "status": "completed", "tag": "25797a64-6610-4c58-afb8-43ff88eb50f7"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:16:00.630614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:16:00.630614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:16:00.649169 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-edbc28d4-31d9-49a7-8012-c826bfa2048b req-16432daf-b730-43b6-ab5e-ba49e3df39c5 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:00.649875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-edbc28d4-31d9-49a7-8012-c826bfa2048b req-16432daf-b730-43b6-ab5e-ba49e3df39c5 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:00.665279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-edbc28d4-31d9-49a7-8012-c826bfa2048b req-16432daf-b730-43b6-ab5e-ba49e3df39c5 service nova] Creating event network-vif-plugged:25797a64-6610-4c58-afb8-43ff88eb50f7 for instance e809722e-dbfd-42d6-8563-74ca78108388 on hv-cinder-82635 Jan 27 16:16:00.690002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-edbc28d4-31d9-49a7-8012-c826bfa2048b req-16432daf-b730-43b6-ab5e-ba49e3df39c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065431 Jan 27 16:16:00.690621 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 743/1477] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:16:00.712686 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:00.721115 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a25fcc9c-eaff-4b74-bfe3-9f0ab789f97b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.182878 Jan 27 16:16:00.721704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 735/1478] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:00 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:01.738461 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:01.739761 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:01.746457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:01.747202 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:01.747994 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:01.748599 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:01.926323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:01.935526 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-97eecb74-663e-46b0-989f-4dd4f5ee8ce8 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1266 microversion: 2.1 time: 0.201040 Jan 27 16:16:01.945768 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 744/1479] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:01 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:02.952773 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:02.954398 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:02.964222 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:02.965210 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:02.966825 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:02.967589 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:03.118641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:03.134058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e27a11d3-09d5-4429-a90d-6e6ff79e3de4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1454 microversion: 2.1 time: 0.184602 Jan 27 16:16:03.152508 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 736/1480] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:02 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:03.167408 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:03.168936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:03.185750 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:03.186632 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:03.188771 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:03.190282 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:03.392000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:03.400311 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1016031d-2e2a-4622-a840-5fb7b4dc775c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1454 microversion: 2.1 time: 0.240611 Jan 27 16:16:03.401218 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 745/1481] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:03 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1454 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:05.481019 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-4ab787d2-2a04-4e36-ad8f-0274d21371b1 req-5ac28008-ea1b-4770-93dd-4dd837a50f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e809722e-dbfd-42d6-8563-74ca78108388", "tag": "25797a64-6610-4c58-afb8-43ff88eb50f7"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:16:05.484748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:16:05.484748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:16:05.499749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-4ab787d2-2a04-4e36-ad8f-0274d21371b1 req-5ac28008-ea1b-4770-93dd-4dd837a50f1e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:05.501042 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-4ab787d2-2a04-4e36-ad8f-0274d21371b1 req-5ac28008-ea1b-4770-93dd-4dd837a50f1e service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:05.523673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-4ab787d2-2a04-4e36-ad8f-0274d21371b1 req-5ac28008-ea1b-4770-93dd-4dd837a50f1e service nova] Creating event network-changed:25797a64-6610-4c58-afb8-43ff88eb50f7 for instance e809722e-dbfd-42d6-8563-74ca78108388 on hv-cinder-82635 Jan 27 16:16:05.534303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-4ab787d2-2a04-4e36-ad8f-0274d21371b1 req-5ac28008-ea1b-4770-93dd-4dd837a50f1e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057389 Jan 27 16:16:05.550103 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 737/1482] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:16:33.826110 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0781c973-7e98-47fc-b1e2-064fc6f25b42 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Action: 'create', calling method: .version_select at 0x7f78175509d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-949209138"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:16:33.840099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-0781c973-7e98-47fc-b1e2-064fc6f25b42 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Getting quotas for project 482ac7b5c7ed443bb169bb4d7c2d8b24. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:16:33.843800 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-0781c973-7e98-47fc-b1e2-064fc6f25b42 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Getting quotas for user 65399e363e8242e6be572c29a95e6717 and project 482ac7b5c7ed443bb169bb4d7c2d8b24. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:16:34.190231 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-0781c973-7e98-47fc-b1e2-064fc6f25b42 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Getting quotas for project 482ac7b5c7ed443bb169bb4d7c2d8b24. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:16:34.194036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-0781c973-7e98-47fc-b1e2-064fc6f25b42 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Getting quotas for user 65399e363e8242e6be572c29a95e6717 and project 482ac7b5c7ed443bb169bb4d7c2d8b24. Resources: {'key_pairs'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:16:34.207409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0781c973-7e98-47fc-b1e2-064fc6f25b42 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.384960 Jan 27 16:16:34.208019 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 746/1483] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Jan 27 16:16:33 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:16:34.256569 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1841924002", "imageRef": "e36fa974-ab68-4e29-ab80-f2db40772f1c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-949209138", "networks": [{"uuid": "a6d4133c-fb7d-4259-8555-65738ea0bee5"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:16:34.305820 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] validate_networks() for [('a6d4133c-fb7d-4259-8555-65738ea0bee5', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:16:34.674559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:16:34.675027 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:16:34.675743 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:16:34.676486 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:16:34.676909 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:16:34.686938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:34.687438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:34.688238 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:34.688676 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:34.705246 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Getting quotas for project 482ac7b5c7ed443bb169bb4d7c2d8b24. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:16:34.709067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Getting quotas for user 65399e363e8242e6be572c29a95e6717 and project 482ac7b5c7ed443bb169bb4d7c2d8b24. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:16:34.719886 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:16:34.722245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e36fa974-ab68-4e29-ab80-f2db40772f1c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:16:34.770931 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b9f1ec93-5442-4b25-afdf-4f93fd9d88d9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517990 Jan 27 16:16:34.776892 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 738/1484] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:16:34.784208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6840f9a9-2d2a-4b26-936e-17cf9fd14aff tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:34.784818 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6840f9a9-2d2a-4b26-936e-17cf9fd14aff tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:34.837525 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6840f9a9-2d2a-4b26-936e-17cf9fd14aff tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:34.845072 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6840f9a9-2d2a-4b26-936e-17cf9fd14aff tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1258 microversion: 2.1 time: 0.064595 Jan 27 16:16:34.845633 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 747/1485] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:34 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:16:35.863617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:35.864703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:35.870670 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:35.871151 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:35.872189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:35.872623 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:35.934330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:35.941328 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9a594122-cd28-4be2-ab1b-98afddca631f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1316 microversion: 2.1 time: 0.082339 Jan 27 16:16:35.941906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 739/1486] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:35 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1316 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:36.959375 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:36.960765 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:36.968400 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:36.969012 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:36.969852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:36.970550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:37.111810 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:37.121126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-14ac6c3e-1efb-4ed9-b07c-3c17c61b3fb4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.165836 Jan 27 16:16:37.121700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 748/1487] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:36 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:38.140402 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:38.141556 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:38.148722 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:38.149855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:38.150813 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:38.151385 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:38.285919 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:38.300662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-3c8f0a22-9bbc-4c66-a6f0-58846749c5f3 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.159604 Jan 27 16:16:38.301458 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 740/1488] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:38 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:39.317529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:39.318112 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:39.324880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:39.325324 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:39.326092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:39.326519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:39.465000 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:39.472523 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f6bcf15d-ade2-492f-92c5-452ce27dfe6a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.158681 Jan 27 16:16:39.473085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 749/1489] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:39 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:40.489695 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:40.490303 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:40.497073 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:40.497528 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:40.498308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:40.498749 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:40.649576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:40.657834 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-e0de2894-a8c9-4c82-9364-3ec003947668 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.172011 Jan 27 16:16:40.658658 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 741/1490] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:40 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:41.676263 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:41.677058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:41.684205 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:41.684665 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:41.685464 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:41.685901 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:41.821245 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:41.826515 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c15794fe-f9b2-4d5e-ba09-12b613fe0913 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.154630 Jan 27 16:16:41.827113 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 750/1491] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:41 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:42.845502 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:42.846138 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:42.853765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:42.854245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:42.855058 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:42.855500 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:43.000074 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:43.007387 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-19ccaed5-2629-482c-a853-f2aa501539dc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.165485 Jan 27 16:16:43.007956 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 742/1492] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:42 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:44.025941 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:44.027280 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:44.032875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:44.033330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:44.034126 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:44.034559 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:44.174379 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:44.181864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-49c29545-4d89-4bd6-855f-9c988e5578ad tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.159607 Jan 27 16:16:44.182440 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 751/1493] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:44 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:16:45.201131 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:45.201880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:45.208279 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:45.208733 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:45.209539 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:45.209971 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:45.344859 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:45.352692 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-50a01907-ff3d-44eb-a3d7-273113cc364f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.154955 Jan 27 16:16:45.353575 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 743/1494] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:45 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:46.373230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:46.374360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:46.384707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:46.385388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:46.386796 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:46.387658 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:46.529327 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:46.536979 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-3262b853-bd17-4170-887d-699ee5b18631 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.170376 Jan 27 16:16:46.537547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 752/1495] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:46 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:47.555519 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:47.556927 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:47.567550 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:47.568040 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:47.569391 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:47.570153 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:47.717038 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:47.724373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-128e6fdd-4034-4619-808a-5aabcae0012f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.173530 Jan 27 16:16:47.724934 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 744/1496] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:47 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:48.741910 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:48.742508 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:48.749523 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:48.749979 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:48.750791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:48.751260 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:48.973514 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:48.982230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b7ee9c0d-a790-4540-9834-6b4a2cd8b75c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.243929 Jan 27 16:16:48.982814 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 753/1497] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:48 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:49.216580 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-6f31ba6b-4e30-4f30-b9a0-83c64a9c412b req-e289bd4f-1d4e-4f83-832a-275da527ec2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267775e1-6bb6-4993-8e7c-0dea99b29f80", "tag": "bbf54121-87ac-4c62-987e-488dc4dd467a"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:16:49.218180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:16:49.218180 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:16:49.236604 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-6f31ba6b-4e30-4f30-b9a0-83c64a9c412b req-e289bd4f-1d4e-4f83-832a-275da527ec2c service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:49.237305 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-6f31ba6b-4e30-4f30-b9a0-83c64a9c412b req-e289bd4f-1d4e-4f83-832a-275da527ec2c service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:49.249241 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-6f31ba6b-4e30-4f30-b9a0-83c64a9c412b req-e289bd4f-1d4e-4f83-832a-275da527ec2c service nova] Creating event network-changed:bbf54121-87ac-4c62-987e-488dc4dd467a for instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 on hv-cinder-82635 Jan 27 16:16:49.254435 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-6f31ba6b-4e30-4f30-b9a0-83c64a9c412b req-e289bd4f-1d4e-4f83-832a-275da527ec2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042159 Jan 27 16:16:49.255490 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 745/1498] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:16:49.999395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:50.000681 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:50.007359 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:50.007789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:50.008578 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:50.009521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:50.220938 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:50.228707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-afed3c7d-6e41-478e-ac25-0f1965113018 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.232947 Jan 27 16:16:50.229285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 754/1499] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:49 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:51.246655 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:51.247401 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:51.254067 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:51.254546 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:51.255558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:51.255992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:51.394968 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:51.403734 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7c313404-3f2a-4378-8c53-618c401f4c47 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.161558 Jan 27 16:16:51.404313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 746/1500] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:51 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:52.422479 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:52.423387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:52.429905 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:52.430229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:52.431032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:52.431602 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:52.573890 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:52.581475 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6bee42ca-5e7c-4ad9-9b94-1e4712e904d1 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.162647 Jan 27 16:16:52.582054 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 755/1501] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:52 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:53.603929 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:53.604581 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:53.610770 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:53.611250 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:53.612057 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:53.612730 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:53.749156 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:53.756960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0633bfce-c945-456d-b3a5-e1ad22d3f385 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.157072 Jan 27 16:16:53.757537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 747/1502] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:53 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:54.773958 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:54.774650 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:54.780946 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:54.781395 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:54.782177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:54.782609 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:54.916226 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:54.923556 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-1e3e14cb-b5e9-4b75-85c4-99f4ddd7101d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.153483 Jan 27 16:16:54.924129 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 756/1503] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:54 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:55.940785 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:55.941381 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:55.948363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:55.948818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:55.949602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:55.950036 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:56.084569 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:56.092347 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-70c53258-5044-4605-b1fa-36bdb96765cf tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.155218 Jan 27 16:16:56.092929 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 748/1504] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:55 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:56.862734 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-6fe38587-3049-4996-ac3a-d010fabfff14 req-90c5610f-87ca-41e3-8610-93211f097500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267775e1-6bb6-4993-8e7c-0dea99b29f80", "name": "network-vif-plugged", "status": "completed", "tag": "bbf54121-87ac-4c62-987e-488dc4dd467a"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:16:56.864743 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:16:56.864743 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:16:56.871926 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-6fe38587-3049-4996-ac3a-d010fabfff14 req-90c5610f-87ca-41e3-8610-93211f097500 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:56.872373 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-6fe38587-3049-4996-ac3a-d010fabfff14 req-90c5610f-87ca-41e3-8610-93211f097500 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:56.885249 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-6fe38587-3049-4996-ac3a-d010fabfff14 req-90c5610f-87ca-41e3-8610-93211f097500 service nova] Creating event network-vif-plugged:bbf54121-87ac-4c62-987e-488dc4dd467a for instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 on hv-cinder-82635 Jan 27 16:16:56.890411 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-6fe38587-3049-4996-ac3a-d010fabfff14 req-90c5610f-87ca-41e3-8610-93211f097500 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031297 Jan 27 16:16:56.891042 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 757/1505] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:16:57.109035 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:57.109652 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:57.116646 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:57.117093 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:57.117899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:57.118336 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:57.253418 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:57.261228 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c7e52258-94fc-4d7f-8715-18e37b32ef79 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.155960 Jan 27 16:16:57.261787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 749/1506] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:57 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:58.279006 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:58.279788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:58.286036 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:58.286915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:58.287745 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:58.288187 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:58.421500 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:58.429168 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7cf29e0e-7ad5-496b-ba85-7e8760dfd96a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1358 microversion: 2.1 time: 0.155186 Jan 27 16:16:58.429969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 758/1507] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:58 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:59.446375 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:59.446924 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:59.453313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.453765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:59.454553 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.455009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:59.581558 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:59.589383 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-be0e19c6-b776-4391-b668-f4ed6354fed9 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1547 microversion: 2.1 time: 0.146941 Jan 27 16:16:59.589938 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 750/1508] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:59 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:59.605217 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:59.605847 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:59.612059 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.612506 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:59.613536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.613966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:59.739789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:59.747606 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b51ad1d7-46b6-4a76-aa84-4d438c713823 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1547 microversion: 2.1 time: 0.145851 Jan 27 16:16:59.748193 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 759/1509] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:59 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:16:59.763975 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:59.767377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:16:59.767377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:16:59.768448 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:16:59.769207 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Searching by: {'deleted': False, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24'} {{(pid=116261) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 27 16:16:59.776903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.777346 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:59.778152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.778573 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:59.867035 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.multi_cell_list [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116261) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 27 16:16:59.964541 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5fe533a7-6959-446c-9ec0-310833097371 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204612 Jan 27 16:16:59.965121 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 751/1510] 10.222.0.61 () {58 vars in 1124 bytes} [Thu Jan 27 16:16:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:16:59.975075 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:16:59.975614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:16:59.981472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.981879 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:16:59.982724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:16:59.983185 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:00.118455 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:17:00.126214 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-035f831b-5269-412f-9f0d-59006bef66e4 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1547 microversion: 2.1 time: 0.154835 Jan 27 16:17:00.126791 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 760/1511] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:16:59 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:17:01.614032 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8cbd32a5-a9d1-4308-b3d4-6ce751e54978 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e74a8ec9-a49f-4e88-b6bf-aa8e46d099e8"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:17:01.615124 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8cbd32a5-a9d1-4308-b3d4-6ce751e54978 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:17:01.621311 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cbd32a5-a9d1-4308-b3d4-6ce751e54978 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:01.621764 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cbd32a5-a9d1-4308-b3d4-6ce751e54978 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:01.622570 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cbd32a5-a9d1-4308-b3d4-6ce751e54978 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:01.623023 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8cbd32a5-a9d1-4308-b3d4-6ce751e54978 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:01.848481 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8cbd32a5-a9d1-4308-b3d4-6ce751e54978 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238313 Jan 27 16:17:01.849009 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 752/1512] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jan 27 16:17:01 2022] POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:17:09.362680 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:17:09.363314 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:17:09.369644 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:09.370098 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:09.370900 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:09.371377 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:09.501207 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:17:09.508906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-474c1d96-c248-4cd2-9a91-81f9116c4d0c tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1593 microversion: 2.1 time: 0.150016 Jan 27 16:17:09.509469 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 761/1513] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:17:09 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:17:11.185122 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-57838bb8-6558-4fc5-970b-48eaf06d21ec req-df2562a6-a6fb-481f-a69d-98715243d834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267775e1-6bb6-4993-8e7c-0dea99b29f80", "tag": "bbf54121-87ac-4c62-987e-488dc4dd467a"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:17:11.187376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:17:11.187376 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:17:11.195254 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-57838bb8-6558-4fc5-970b-48eaf06d21ec req-df2562a6-a6fb-481f-a69d-98715243d834 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:11.196054 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-57838bb8-6558-4fc5-970b-48eaf06d21ec req-df2562a6-a6fb-481f-a69d-98715243d834 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:11.208922 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-57838bb8-6558-4fc5-970b-48eaf06d21ec req-df2562a6-a6fb-481f-a69d-98715243d834 service nova] Creating event network-changed:bbf54121-87ac-4c62-987e-488dc4dd467a for instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 on hv-cinder-82635 Jan 27 16:17:11.214887 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-57838bb8-6558-4fc5-970b-48eaf06d21ec req-df2562a6-a6fb-481f-a69d-98715243d834 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033832 Jan 27 16:17:11.216014 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 753/1514] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:17:12.230157 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1962389242"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:17:12.230716 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:17:12.237105 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:12.237562 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:12.238363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:12.238801 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:12.378787 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.network.security_group_api [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Adding security group dff1b98e-86c2-4105-bc9d-f2984d68f3d6 to port bbf54121-87ac-4c62-987e-488dc4dd467a Jan 27 16:17:12.986783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-7740c388-b0fc-4e8e-87d7-9b2c9217c1ae tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/action" status: 202 len: 0 microversion: 2.1 time: 0.759458 Jan 27 16:17:12.989736 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 762/1515] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:17:12 2022] POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:17:12.998295 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:17:12.999001 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:17:13.005509 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:13.005959 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:13.006888 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:13.007396 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:13.166453 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:17:13.178437 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-113eab3f-408e-4902-9529-33e82760e01f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1758 microversion: 2.1 time: 0.181393 Jan 27 16:17:13.180752 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 754/1516] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:17:12 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:17:13.231686 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-47ce7d8f-6133-411b-b9c4-210f41dc1477 req-0c4355ed-4dde-467a-962e-46f16b0ae250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267775e1-6bb6-4993-8e7c-0dea99b29f80", "tag": "bbf54121-87ac-4c62-987e-488dc4dd467a"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:17:13.233246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:17:13.233246 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:17:13.240970 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-47ce7d8f-6133-411b-b9c4-210f41dc1477 req-0c4355ed-4dde-467a-962e-46f16b0ae250 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:17:13.241414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-47ce7d8f-6133-411b-b9c4-210f41dc1477 req-0c4355ed-4dde-467a-962e-46f16b0ae250 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:17:13.252582 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-47ce7d8f-6133-411b-b9c4-210f41dc1477 req-0c4355ed-4dde-467a-962e-46f16b0ae250 service nova] Creating event network-changed:bbf54121-87ac-4c62-987e-488dc4dd467a for instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 on hv-cinder-82635 Jan 27 16:17:13.257619 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-47ce7d8f-6133-411b-b9c4-210f41dc1477 req-0c4355ed-4dde-467a-962e-46f16b0ae250 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029533 Jan 27 16:17:13.258225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 763/1517] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:18:13.020552 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:18:13.021441 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:18:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:18:13.676847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c32bc78b-94a2-49ce-b805-30e698c88196 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:18:13.677836 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c32bc78b-94a2-49ce-b805-30e698c88196 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:13.684229 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c32bc78b-94a2-49ce-b805-30e698c88196 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:13.684675 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c32bc78b-94a2-49ce-b805-30e698c88196 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:13.685461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c32bc78b-94a2-49ce-b805-30e698c88196 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:13.685895 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c32bc78b-94a2-49ce-b805-30e698c88196 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:13.761307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c32bc78b-94a2-49ce-b805-30e698c88196 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/action" status: 202 len: 0 microversion: 2.1 time: 0.088470 Jan 27 16:18:13.762349 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 755/1518] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:18:13 2022] POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:18:13.774189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:13.774885 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:13.783224 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:13.783852 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:13.784662 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:13.785094 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:14.244591 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:14.253610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-5a59a0d8-2962-47ac-b29c-a14105bde0de tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1750 microversion: 2.1 time: 0.486118 Jan 27 16:18:14.254190 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 764/1519] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:13 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1750 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:15.272390 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:15.273082 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:15.279765 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:15.280214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:15.280994 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:15.281429 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:15.489669 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:15.500095 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cbdf2529-4b4b-4002-9319-4ca8dcc55a26 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.231757 Jan 27 16:18:15.500716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 756/1520] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:15 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:16.520552 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:16.521550 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:16.528711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:16.529177 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:16.530044 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:16.530496 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:16.718696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:16.726893 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-df0fc2cb-7168-4de1-8b93-620de67a19a5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.210690 Jan 27 16:18:16.727706 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 765/1521] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:16 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:17.745557 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:17.746189 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:17.752907 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:17.753362 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:17.754217 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:17.754734 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:17.910682 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:17.919215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-cd17b01f-1834-4bf2-b06d-b2e242eb0519 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.177487 Jan 27 16:18:17.919854 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 757/1522] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:17 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:18.936625 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:18.937279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:18.943907 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:18.944355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:18.945149 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:18.945585 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:19.112415 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:19.120908 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-273ed93f-56a0-4e9a-96dc-9cfc7bb6197b tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.187922 Jan 27 16:18:19.121497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 766/1523] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:18 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:20.138267 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:20.139104 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:20.147177 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:20.147674 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:20.152553 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:20.153046 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:20.310837 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:20.318821 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-6c830dce-9484-4982-bd43-38399e48205f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.184253 Jan 27 16:18:20.319416 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 758/1524] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:20 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:21.337914 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:21.338569 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:21.346593 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:21.347073 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:21.347956 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:21.348405 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:21.537946 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:21.548302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-04556957-eebd-4a27-bf8e-a398d1314c41 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.214204 Jan 27 16:18:21.548892 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 767/1525] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:21 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:22.566559 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:22.567196 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:22.573889 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:22.574477 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:22.575322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:22.575788 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:22.748149 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:22.757072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-84be5954-25a9-4369-b932-fce373e2ba43 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.194076 Jan 27 16:18:22.757638 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 759/1526] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:22 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:23.780422 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:23.781417 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:23.789142 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:23.789664 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:23.790934 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:23.791236 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:23.962392 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:23.971291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-ecd4e272-ad1d-49de-ad7a-54684245822f tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.194505 Jan 27 16:18:23.971894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 768/1527] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:23 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:24.990878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:24.991771 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:25.000856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:25.001309 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:25.002181 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:25.002620 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:25.178317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:25.186789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-7775e5ac-bad6-4b97-b534-580dfb24f323 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1755 microversion: 2.1 time: 0.200016 Jan 27 16:18:25.187430 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 760/1528] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:24 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:26.204233 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:26.204844 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:26.211257 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:26.211665 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:26.212437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:26.212867 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:26.356752 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:26.365354 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d85ca0eb-0ad0-48fe-bbdf-2dd1c33d3fdd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1758 microversion: 2.1 time: 0.164822 Jan 27 16:18:26.365928 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 769/1529] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:26 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:32.888618 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:32.889728 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:32.895887 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:32.896333 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:32.897109 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:32.897544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:32.922642 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Going to try to terminate instance {{(pid=116261) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:18:32.995979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4b351108-1bf4-44be-954c-573eeda793ba tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 204 len: 0 microversion: 2.1 time: 0.110411 Jan 27 16:18:32.996537 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 761/1530] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:18:32 2022] DELETE /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:18:33.005339 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:33.005977 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:33.012305 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:33.012760 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:33.013545 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:33.013987 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:33.148781 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:33.156746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2f014b6d-e734-4a97-962e-79c88f73217b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1579 microversion: 2.1 time: 0.155024 Jan 27 16:18:33.157342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 770/1531] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:33 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:34.174561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:34.175276 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:34.181640 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:34.182081 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:34.182863 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:34.183332 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:34.562221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:34.569793 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5aaa90b8-3e48-425b-ba8e-0199b235872f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1579 microversion: 2.1 time: 0.399701 Jan 27 16:18:34.570382 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 762/1532] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:34 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1579 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:35.586434 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:35.587066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:35.594439 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:35.594912 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:35.595996 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:35.596558 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:35.672406 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-8f450d96-0856-46d0-8e2b-067f843c5240 req-e57f594a-7f91-4920-a4d9-322f9a3b6737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e809722e-dbfd-42d6-8563-74ca78108388", "name": "network-vif-deleted", "tag": "25797a64-6610-4c58-afb8-43ff88eb50f7"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:18:35.673947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:18:35.673947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:18:35.681979 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-8f450d96-0856-46d0-8e2b-067f843c5240 req-e57f594a-7f91-4920-a4d9-322f9a3b6737 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:35.682710 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-8f450d96-0856-46d0-8e2b-067f843c5240 req-e57f594a-7f91-4920-a4d9-322f9a3b6737 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:35.695065 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-8f450d96-0856-46d0-8e2b-067f843c5240 req-e57f594a-7f91-4920-a4d9-322f9a3b6737 service nova] Creating event network-vif-deleted:25797a64-6610-4c58-afb8-43ff88eb50f7 for instance e809722e-dbfd-42d6-8563-74ca78108388 on hv-cinder-82635 Jan 27 16:18:35.700232 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:35.700896 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-8f450d96-0856-46d0-8e2b-067f843c5240 req-e57f594a-7f91-4920-a4d9-322f9a3b6737 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032385 Jan 27 16:18:35.703205 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 763/1533] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:18:35.718927 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-c786044c-b2c5-4c69-a8a3-5238e945e536 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 200 len: 1512 microversion: 2.1 time: 0.135957 Jan 27 16:18:35.719966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 771/1534] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:35 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 1512 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:36.747293 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:36.749709 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:36.757639 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:36.757995 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:36.759106 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:36.759593 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:36.776804 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] HTTP exception thrown: Instance e809722e-dbfd-42d6-8563-74ca78108388 could not be found. Jan 27 16:18:36.777388 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Returning 404 to user: Instance e809722e-dbfd-42d6-8563-74ca78108388 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:18:36.778214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-f7c9cde4-65b2-4528-8565-44d91ab63b2b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 404 len: 111 microversion: 2.1 time: 0.037566 Jan 27 16:18:36.778763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 764/1535] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:36 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:18:36.875931 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1722923253", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1991526380", "security_groups": [{"name": "tempest-secgroup-smoke-721451781"}], "block_device_mapping_v2": [{"uuid": "c310b908-16c5-4aec-99a3-83701c256ee9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "44707522-96bc-4e9e-a009-bd6fc4ac0fe0"}]}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:18:36.992467 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.network.neutron [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] validate_networks() for [('44707522-96bc-4e9e-a009-bd6fc4ac0fe0', None, None, None, None, None)] {{(pid=116260) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:18:37.351163 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Flavor limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:18:37.351586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Image limits 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:18:37.352090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Flavor pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:18:37.352493 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Image pref 0:0:0 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:18:37.352901 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.virt.hardware [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:18:37.362346 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:37.362789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:37.363628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:37.364058 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:37.380714 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for project fa3984d8f6dc40258844819aa562633f. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:18:37.384671 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.quota [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for user 24f28c63ddb848b4b5e948bb30e4f6da and project fa3984d8f6dc40258844819aa562633f. Resources: {'cores', 'ram', 'instances'} {{(pid=116260) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:18:37.442363 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Going to run 1 instances... {{(pid=116260) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:18:37.444524 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c310b908-16c5-4aec-99a3-83701c256ee9',volume_size=None,volume_type=None)] {{(pid=116260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:18:37.580775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-4c5468f5-ba18-4ea6-98ca-da251af4d8aa tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709030 Jan 27 16:18:37.581424 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 772/1536] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:18:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:18:37.594815 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-fd22d45e-19aa-44c0-a5a1-4d1aa6f098ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:37.596308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-fd22d45e-19aa-44c0-a5a1-4d1aa6f098ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:37.657354 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-fd22d45e-19aa-44c0-a5a1-4d1aa6f098ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:37.664147 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-fd22d45e-19aa-44c0-a5a1-4d1aa6f098ea tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1095 microversion: 2.1 time: 0.076173 Jan 27 16:18:37.664715 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 765/1537] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:37 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:38.681839 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:38.682449 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:38.689987 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:38.690431 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:38.691473 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:38.692039 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:38.773349 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:38.784024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-14ebcf39-355a-4220-b61f-3f4751a186eb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1211 microversion: 2.1 time: 0.106170 Jan 27 16:18:38.784610 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 773/1538] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:38 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:39.801783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:39.802384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:39.813324 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:39.813778 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:39.815215 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:39.815662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:39.979617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:39.988097 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dc80c289-03b1-41b6-b2af-3824f9c9270d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.190388 Jan 27 16:18:39.988935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 766/1539] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:39 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:40.055434 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-92c40eb4-dfd5-472c-9358-f8a70081f154 req-e3b5c2fd-bc1e-4950-9e44-2588d2328cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ca1cd3-ba62-49ad-8347-94440c81f23e", "tag": "96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:18:40.060666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:18:40.060666 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:18:40.074437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-92c40eb4-dfd5-472c-9358-f8a70081f154 req-e3b5c2fd-bc1e-4950-9e44-2588d2328cf6 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:40.075197 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-92c40eb4-dfd5-472c-9358-f8a70081f154 req-e3b5c2fd-bc1e-4950-9e44-2588d2328cf6 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:40.090932 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-92c40eb4-dfd5-472c-9358-f8a70081f154 req-e3b5c2fd-bc1e-4950-9e44-2588d2328cf6 service nova] Creating event network-changed:96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d for instance e9ca1cd3-ba62-49ad-8347-94440c81f23e on hv-cinder-82635 Jan 27 16:18:40.097880 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-92c40eb4-dfd5-472c-9358-f8a70081f154 req-e3b5c2fd-bc1e-4950-9e44-2588d2328cf6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049286 Jan 27 16:18:40.099894 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 774/1540] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:18:41.005461 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:41.006050 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:41.013527 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:41.013988 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:41.015348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:41.016063 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:41.153906 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:41.164348 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5cd778ff-11bd-4cbf-a483-51da9322fbac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.162609 Jan 27 16:18:41.164918 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 767/1541] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:41 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:42.181639 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:42.182357 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:42.189609 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:42.190066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:42.190862 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:42.191328 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:42.340161 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:42.348109 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eb1b60f3-bb6f-4015-8b77-b840057c1576 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.170564 Jan 27 16:18:42.348687 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 775/1542] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:42 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:43.364641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:43.365247 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:43.371782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:43.372241 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:43.373020 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:43.373460 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:43.508488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:43.516685 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1cdc7d32-5458-4431-a443-2ba4fc573d06 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.155643 Jan 27 16:18:43.517264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 768/1543] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:43 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:44.534352 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:44.535001 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:44.541519 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:44.541979 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:44.542775 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:44.543360 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:44.683568 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:44.690948 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-158f93f5-ec62-42e4-a910-44fce48bab6e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.160801 Jan 27 16:18:44.691647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 776/1544] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:44 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:45.707705 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:45.708301 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:45.714591 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:45.715072 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:45.715856 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:45.716296 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:45.846326 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:45.853547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-91e082e2-7966-4a92-b3bb-71a06acdc573 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.149489 Jan 27 16:18:45.854105 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 769/1545] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:45 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:46.871099 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:46.871957 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:46.878362 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:46.878820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:46.879708 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:46.880093 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:47.015247 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:47.022741 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f6dd7ea5-e977-4e06-ac8b-0efbc923136c tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.155632 Jan 27 16:18:47.023347 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 777/1546] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:46 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:48.040214 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:48.040832 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:48.047703 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:48.048153 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:48.048935 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:48.049373 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:48.180513 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:48.186704 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-5c13dc96-f375-477a-be1c-bef4fccb336e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.150054 Jan 27 16:18:48.187314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 770/1547] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:48 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:49.203397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:49.203999 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:49.210546 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:49.211022 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:49.211829 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:49.212270 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:49.351641 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:49.359759 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2cc32ceb-8b87-4ecd-9097-314cca74bf19 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.159972 Jan 27 16:18:49.360332 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 778/1548] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:49 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:50.376903 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:50.377504 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:50.383779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:50.384234 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:50.385026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:50.385464 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:50.520523 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:50.527816 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-05b3bd35-c0f7-480f-b89b-a19c72371e7d tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.154709 Jan 27 16:18:50.528377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 771/1549] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:50 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:51.348677 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-055ff22d-2945-4cb6-8039-a296d0336e08 req-6ae19a38-7142-4f5b-bd26-c41101976f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ca1cd3-ba62-49ad-8347-94440c81f23e", "name": "network-vif-plugged", "status": "completed", "tag": "96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:18:51.350244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:18:51.350244 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:18:51.357783 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-055ff22d-2945-4cb6-8039-a296d0336e08 req-6ae19a38-7142-4f5b-bd26-c41101976f65 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:51.358856 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-055ff22d-2945-4cb6-8039-a296d0336e08 req-6ae19a38-7142-4f5b-bd26-c41101976f65 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:51.370541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-055ff22d-2945-4cb6-8039-a296d0336e08 req-6ae19a38-7142-4f5b-bd26-c41101976f65 service nova] Creating event network-vif-plugged:96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d for instance e9ca1cd3-ba62-49ad-8347-94440c81f23e on hv-cinder-82635 Jan 27 16:18:51.376611 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-055ff22d-2945-4cb6-8039-a296d0336e08 req-6ae19a38-7142-4f5b-bd26-c41101976f65 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Jan 27 16:18:51.377228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 779/1550] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:18:51.544491 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:51.545052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:51.551912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:51.552389 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:51.553261 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:51.553692 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:51.687782 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:51.695059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-9d1567ce-f9ce-45f7-b976-e17b22650ccb tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.154389 Jan 27 16:18:51.695619 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 772/1551] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:51 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:52.713096 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:52.713794 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:52.720380 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:52.720834 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:52.721614 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:52.722051 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:52.862476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:52.871085 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6819fe08-88d0-4540-bbca-ba6a0106f2cc tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1266 microversion: 2.1 time: 0.162578 Jan 27 16:18:52.871943 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 780/1552] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:52 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:53.890143 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:53.890758 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:53.897043 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:53.897492 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:53.898270 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:53.898708 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:54.035003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:54.043761 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2d949f95-fb3b-4e9a-93f7-18e18c69dcfd tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1454 microversion: 2.1 time: 0.157131 Jan 27 16:18:54.044361 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 773/1553] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:53 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:54.061208 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:18:54.061889 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:18:54.069364 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:54.069820 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:54.070718 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:54.071183 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:54.218505 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:18:54.225789 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cf08c210-cce0-4f0e-8fb2-86424fe9e709 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1454 microversion: 2.1 time: 0.168613 Jan 27 16:18:54.226697 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 781/1554] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:18:54 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:18:55.938787 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-c2bd9156-70c1-46cb-b116-59b9982f6752 req-9078e852-27dd-4f4e-82ed-61abe29e7afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ca1cd3-ba62-49ad-8347-94440c81f23e", "tag": "96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:18:55.944576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:18:55.944576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:18:55.947985 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-c2bd9156-70c1-46cb-b116-59b9982f6752 req-9078e852-27dd-4f4e-82ed-61abe29e7afb service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:18:55.948307 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-c2bd9156-70c1-46cb-b116-59b9982f6752 req-9078e852-27dd-4f4e-82ed-61abe29e7afb service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:18:55.960872 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-c2bd9156-70c1-46cb-b116-59b9982f6752 req-9078e852-27dd-4f4e-82ed-61abe29e7afb service nova] Creating event network-changed:96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d for instance e9ca1cd3-ba62-49ad-8347-94440c81f23e on hv-cinder-82635 Jan 27 16:18:55.966289 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-c2bd9156-70c1-46cb-b116-59b9982f6752 req-9078e852-27dd-4f4e-82ed-61abe29e7afb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090050 Jan 27 16:18:55.966863 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 774/1555] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:19:29.491713 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:19:29.492403 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:19:30.032079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1962389242"}} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:19:30.032693 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:30.038855 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:30.039491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:30.040285 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:30.040724 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:30.171567 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.network.security_group_api [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Removing security group dff1b98e-86c2-4105-bc9d-f2984d68f3d6 from port bbf54121-87ac-4c62-987e-488dc4dd467a Jan 27 16:19:30.514219 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f801baeb-24b8-439f-849e-f7cc014f73cc tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/action" status: 202 len: 0 microversion: 2.1 time: 0.485934 Jan 27 16:19:30.518757 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 782/1556] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jan 27 16:19:30 2022] POST /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:19:30.605406 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-be4bc9f4-0008-465f-b48e-07ebe4868711 req-3254ac68-d1c5-4762-a334-8e691d1d64db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267775e1-6bb6-4993-8e7c-0dea99b29f80", "tag": "bbf54121-87ac-4c62-987e-488dc4dd467a"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:19:30.607161 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:19:30.607161 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:19:30.615688 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-be4bc9f4-0008-465f-b48e-07ebe4868711 req-3254ac68-d1c5-4762-a334-8e691d1d64db service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:30.616306 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-be4bc9f4-0008-465f-b48e-07ebe4868711 req-3254ac68-d1c5-4762-a334-8e691d1d64db service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:30.628012 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-be4bc9f4-0008-465f-b48e-07ebe4868711 req-3254ac68-d1c5-4762-a334-8e691d1d64db service nova] Creating event network-changed:bbf54121-87ac-4c62-987e-488dc4dd467a for instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 on hv-cinder-82635 Jan 27 16:19:30.634663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-be4bc9f4-0008-465f-b48e-07ebe4868711 req-3254ac68-d1c5-4762-a334-8e691d1d64db service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115237 Jan 27 16:19:30.635625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 775/1557] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:19:31.705423 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:31.705961 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:31.708791 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-1470d499-9981-4caa-8733-abdef52fd7f0 req-e3b52f51-5c88-43e6-9b5a-eac313f53ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267775e1-6bb6-4993-8e7c-0dea99b29f80", "tag": "bbf54121-87ac-4c62-987e-488dc4dd467a"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:19:31.710463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:19:31.710463 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:19:31.713088 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:31.719170 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-1470d499-9981-4caa-8733-abdef52fd7f0 req-e3b52f51-5c88-43e6-9b5a-eac313f53ac7 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:31.719861 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-1470d499-9981-4caa-8733-abdef52fd7f0 req-e3b52f51-5c88-43e6-9b5a-eac313f53ac7 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:31.720992 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:31.721864 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:31.722306 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:31.732993 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-1470d499-9981-4caa-8733-abdef52fd7f0 req-e3b52f51-5c88-43e6-9b5a-eac313f53ac7 service nova] Creating event network-changed:bbf54121-87ac-4c62-987e-488dc4dd467a for instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 on hv-cinder-82635 Jan 27 16:19:31.739064 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-1470d499-9981-4caa-8733-abdef52fd7f0 req-e3b52f51-5c88-43e6-9b5a-eac313f53ac7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034374 Jan 27 16:19:31.740317 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 776/1558] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:19:31.813376 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lazy-loading 'services' on Instance uuid 267775e1-6bb6-4993-8e7c-0dea99b29f80 {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:19:31.891592 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-56938736-dbee-4c70-a95d-d0dcc84900f5 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "DELETE /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments/e74a8ec9-a49f-4e88-b6bf-aa8e46d099e8" status: 202 len: 0 microversion: 2.1 time: 0.189922 Jan 27 16:19:31.892644 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 783/1559] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:19:31 2022] DELETE /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments/e74a8ec9-a49f-4e88-b6bf-aa8e46d099e8 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:19:31.911393 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-2ebbeb69-05f5-40e3-90cf-0c034223f857 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:31.912849 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-2ebbeb69-05f5-40e3-90cf-0c034223f857 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:31.928777 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ebbeb69-05f5-40e3-90cf-0c034223f857 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:31.929632 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ebbeb69-05f5-40e3-90cf-0c034223f857 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:31.930701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ebbeb69-05f5-40e3-90cf-0c034223f857 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:31.931512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-2ebbeb69-05f5-40e3-90cf-0c034223f857 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:31.967130 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-2ebbeb69-05f5-40e3-90cf-0c034223f857 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063888 Jan 27 16:19:31.967866 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 777/1560] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:19:31 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:19:32.980501 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f155b9b2-9ec9-40c7-8a7a-f7c3ed46e34d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:32.981457 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f155b9b2-9ec9-40c7-8a7a-f7c3ed46e34d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:32.988262 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f155b9b2-9ec9-40c7-8a7a-f7c3ed46e34d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:32.988715 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f155b9b2-9ec9-40c7-8a7a-f7c3ed46e34d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:32.989497 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f155b9b2-9ec9-40c7-8a7a-f7c3ed46e34d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:32.989931 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f155b9b2-9ec9-40c7-8a7a-f7c3ed46e34d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:33.018313 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f155b9b2-9ec9-40c7-8a7a-f7c3ed46e34d tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042516 Jan 27 16:19:33.018875 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 784/1561] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jan 27 16:19:32 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:19:33.028767 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:33.029308 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:33.036218 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:33.036683 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:33.037433 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:33.037855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:33.112512 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] HTTP exception thrown: Instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 is not attached to volume e74a8ec9-a49f-4e88-b6bf-aa8e46d099e8 Jan 27 16:19:33.113003 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Returning 404 to user: Instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 is not attached to volume e74a8ec9-a49f-4e88-b6bf-aa8e46d099e8 {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:19:33.113857 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-4813fd79-5072-499d-8c46-053806f8c3b6 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "DELETE /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments/e74a8ec9-a49f-4e88-b6bf-aa8e46d099e8" status: 404 len: 154 microversion: 2.1 time: 0.088918 Jan 27 16:19:33.114371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 778/1562] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jan 27 16:19:33 2022] DELETE /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80/os-volume_attachments/e74a8ec9-a49f-4e88-b6bf-aa8e46d099e8 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:19:34.251128 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:34.251726 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:34.257787 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:34.258228 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:34.259041 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:34.259472 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:34.285589 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:19:34.365397 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-b2ba82ac-1751-4922-85df-f4f4b2276056 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "DELETE /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 204 len: 0 microversion: 2.1 time: 0.118742 Jan 27 16:19:34.366293 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 785/1563] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:19:34 2022] DELETE /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:19:34.374712 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:34.376042 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:34.383796 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:34.384291 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:34.385114 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:34.385549 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:34.525488 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:19:34.533673 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dd70d896-353e-498e-bdd3-768f04be803a tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1553 microversion: 2.1 time: 0.162862 Jan 27 16:19:34.534235 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 779/1564] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:19:34 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:19:35.552541 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:35.553229 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:35.559560 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:35.560002 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:35.560776 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:35.561209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:35.693937 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:19:35.701279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-eccfafd1-add2-4236-ad4d-564b0ccd0d77 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1553 microversion: 2.1 time: 0.152893 Jan 27 16:19:35.701840 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 786/1565] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:19:35 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:19:36.717572 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:36.718166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:36.725198 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:36.725641 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:36.726415 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:36.726847 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:36.866010 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65399e363e8242e6be572c29a95e6717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482ac7b5c7ed443bb169bb4d7c2d8b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:19:36.876818 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-28a1ff57-9164-4623-b2f1-e05612fa43ce tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 200 len: 1553 microversion: 2.1 time: 0.162856 Jan 27 16:19:36.878438 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 780/1566] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:19:36 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:19:36.961355 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-ab88a675-5f19-4d0d-a3f5-888693ae089c req-11baac01-3fe8-400a-a5ab-8334f4679ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267775e1-6bb6-4993-8e7c-0dea99b29f80", "name": "network-vif-deleted", "tag": "bbf54121-87ac-4c62-987e-488dc4dd467a"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:19:36.963047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:19:36.963047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:19:36.970613 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-ab88a675-5f19-4d0d-a3f5-888693ae089c req-11baac01-3fe8-400a-a5ab-8334f4679ce1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:36.971092 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-ab88a675-5f19-4d0d-a3f5-888693ae089c req-11baac01-3fe8-400a-a5ab-8334f4679ce1 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:36.982554 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-ab88a675-5f19-4d0d-a3f5-888693ae089c req-11baac01-3fe8-400a-a5ab-8334f4679ce1 service nova] Creating event network-vif-deleted:bbf54121-87ac-4c62-987e-488dc4dd467a for instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 on hv-cinder-82635 Jan 27 16:19:36.987747 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-ab88a675-5f19-4d0d-a3f5-888693ae089c req-11baac01-3fe8-400a-a5ab-8334f4679ce1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030232 Jan 27 16:19:36.988341 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 787/1567] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:19:37.895087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:37.895701 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [instance: 267775e1-6bb6-4993-8e7c-0dea99b29f80] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:19:37.901969 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:37.902416 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:37.903230 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:19:37.903666 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:19:37.917542 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] HTTP exception thrown: Instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 could not be found. Jan 27 16:19:37.918128 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Returning 404 to user: Instance 267775e1-6bb6-4993-8e7c-0dea99b29f80 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:19:37.919026 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-693eb850-ca0d-462b-b890-b12d0fe47bcd tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80" status: 404 len: 111 microversion: 2.1 time: 0.027583 Jan 27 16:19:37.919562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 781/1568] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:19:37 2022] GET /compute/v2.1/servers/267775e1-6bb6-4993-8e7c-0dea99b29f80 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:19:37.928370 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-6d67d177-dca0-49b5-b969-8b39306f2a89 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] Calling method '.version_select at 0x7f78122738b0>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:19:37.931713 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d67d177-dca0-49b5-b969-8b39306f2a89 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [4d664198-d3a2-443c-9157-9f9382509786] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 27 16:19:38.940024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d67d177-dca0-49b5-b969-8b39306f2a89 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] [4d664198-d3a2-443c-9157-9f9382509786] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42754. Jan 27 16:19:38.959906 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-6d67d177-dca0-49b5-b969-8b39306f2a89 tempest-TestMinimumBasicScenario-52762975 tempest-TestMinimumBasicScenario-52762975-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-949209138" status: 202 len: 0 microversion: 2.1 time: 1.035453 Jan 27 16:19:38.960504 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 788/1569] 10.222.0.61 () {58 vars in 1268 bytes} [Thu Jan 27 16:19:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-949209138 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:19:50.367830 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:19:50.368363 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:19:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:21:10.820721 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-495819432", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1991526380", "security_groups": [{"name": "tempest-secgroup-smoke-721451781"}], "block_device_mapping_v2": [{"uuid": "49abae76-90dd-4c5e-8df1-fa34ca71571e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "44707522-96bc-4e9e-a009-bd6fc4ac0fe0"}]}} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:21:10.932034 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.network.neutron [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] validate_networks() for [('44707522-96bc-4e9e-a009-bd6fc4ac0fe0', None, None, None, None, None)] {{(pid=116261) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:21:11.401563 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Flavor limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:21:11.401990 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Image limits 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:21:11.402472 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Flavor pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:21:11.402899 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Image pref 0:0:0 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:21:11.403345 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.virt.hardware [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:21:11.412351 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:11.412800 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:11.413617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:11.414053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:11.430396 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for project fa3984d8f6dc40258844819aa562633f. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:21:11.434280 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.quota [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Getting quotas for user 24f28c63ddb848b4b5e948bb30e4f6da and project fa3984d8f6dc40258844819aa562633f. Resources: {'cores', 'ram', 'instances'} {{(pid=116261) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:21:11.488516 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Going to run 1 instances... {{(pid=116261) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:21:11.490630 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49abae76-90dd-4c5e-8df1-fa34ca71571e',volume_size=None,volume_type=None)] {{(pid=116261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:21:11.617157 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-0f93fae7-76b2-4dd7-bbb9-11fc0e36b7be tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.801032 Jan 27 16:21:11.617985 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 782/1570] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jan 27 16:21:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:21:11.629061 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-60f5482c-18e7-4930-a100-66ccf3e71a09 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:11.629786 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-60f5482c-18e7-4930-a100-66ccf3e71a09 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:11.686135 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-60f5482c-18e7-4930-a100-66ccf3e71a09 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:11.692807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-60f5482c-18e7-4930-a100-66ccf3e71a09 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1094 microversion: 2.1 time: 0.068936 Jan 27 16:21:11.693682 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 789/1571] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:11 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:12.709776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:12.710342 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:12.717912 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:12.718426 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:12.719784 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:12.720220 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:12.788171 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:12.795862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a737b369-5790-450c-9d82-91638fdcb4fe tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1192 microversion: 2.1 time: 0.089846 Jan 27 16:21:12.796658 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 783/1572] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:12 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:13.813461 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:13.814205 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:13.821065 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:13.821600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:13.822480 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:13.822915 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:14.167966 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:14.176378 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e82e330c-63f1-445d-a13a-602ac2bbe409 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.366590 Jan 27 16:21:14.186398 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 790/1573] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:13 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:14.576807 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-258fca8e-4e47-4e90-9744-c14189f2ddfd req-4e8ffde4-1ffa-4781-9246-0790fd21b94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648987d6-d2c1-4198-b652-2ba2b1d7c205", "tag": "b4ddffb5-c594-4396-8d6b-9b3aceafede4"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:21:14.580264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:21:14.580264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:21:14.589699 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-258fca8e-4e47-4e90-9744-c14189f2ddfd req-4e8ffde4-1ffa-4781-9246-0790fd21b94a service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:14.590136 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-258fca8e-4e47-4e90-9744-c14189f2ddfd req-4e8ffde4-1ffa-4781-9246-0790fd21b94a service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:14.603392 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-258fca8e-4e47-4e90-9744-c14189f2ddfd req-4e8ffde4-1ffa-4781-9246-0790fd21b94a service nova] Creating event network-changed:b4ddffb5-c594-4396-8d6b-9b3aceafede4 for instance 648987d6-d2c1-4198-b652-2ba2b1d7c205 on hv-cinder-82635 Jan 27 16:21:14.616447 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-258fca8e-4e47-4e90-9744-c14189f2ddfd req-4e8ffde4-1ffa-4781-9246-0790fd21b94a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044071 Jan 27 16:21:14.617286 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 784/1574] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:21:15.193323 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:15.194029 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:15.200251 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:15.200698 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:15.201463 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:15.201895 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:15.407235 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:15.414572 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-31721ddf-c6c6-4c98-bff6-20a7d436f39a tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.224810 Jan 27 16:21:15.415180 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 791/1575] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:15 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:16.433947 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:16.434631 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:16.440668 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:16.441112 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:16.441878 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:16.442304 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:16.574763 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:16.582740 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1489d68f-4793-422d-a9f2-2752a78bb869 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.153233 Jan 27 16:21:16.583331 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 785/1576] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:16 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:21:17.598878 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:17.599540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:17.605866 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:17.606325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:17.607146 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:17.607586 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:17.737330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:17.744640 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-cbd5a3d0-1bb4-47c6-a998-59fbe8931544 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.149382 Jan 27 16:21:17.745209 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 792/1577] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:17 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:18.761776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:18.762377 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:18.769330 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:18.769778 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:18.770567 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:18.771027 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:18.916547 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:18.923880 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-1107bcf1-7c59-49d3-b3b1-03cf8dee3b8f tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.165753 Jan 27 16:21:18.924449 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 786/1578] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:18 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:19.940432 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:19.941066 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:19.947362 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:19.947809 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:19.948590 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:19.949032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:20.086746 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:20.094707 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-8dc50ff2-d56b-4747-814f-08366942555e tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.157944 Jan 27 16:21:20.095298 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 793/1579] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:19 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:21.111155 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:21.111789 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:21.118053 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:21.118499 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:21.119313 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:21.119748 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:21.252392 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:21.259561 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-b5ca911e-66bb-448d-941e-c91b00e8aae5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.152063 Jan 27 16:21:21.260117 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 787/1580] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:21 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:22.276089 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:22.276848 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:22.283754 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:22.284205 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:22.284986 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:22.285427 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:22.414143 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:22.421414 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-f4e1add1-205e-4116-b673-62dfd163b6b7 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.148961 Jan 27 16:21:22.421972 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 794/1581] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:22 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:23.437812 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:23.438424 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:23.444813 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:23.445264 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:23.446049 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:23.446481 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:23.581115 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:23.588738 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-a80eedb6-01ea-4db9-971c-ee233af15eab tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.154476 Jan 27 16:21:23.589371 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 788/1582] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:23 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:24.605487 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:24.606132 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:24.613079 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:24.613536 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:24.614330 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:24.614767 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:24.750291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:24.757792 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-70f789f2-74bc-4822-9712-3c0049d97668 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.156009 Jan 27 16:21:24.758350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 795/1583] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:24 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:25.773562 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:25.774167 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:25.780597 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:25.781052 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:25.781844 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:25.782284 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:26.131951 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [req-2e3b60b4-4160-4d1c-89fa-91b0a4e7071d req-f151c5bd-a648-4345-ab4a-2b191508ae12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648987d6-d2c1-4198-b652-2ba2b1d7c205", "name": "network-vif-plugged", "status": "completed", "tag": "b4ddffb5-c594-4396-8d6b-9b3aceafede4"}]} {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:21:26.133547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:21:26.133547 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: warnings.warn(msg) Jan 27 16:21:26.141090 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2e3b60b4-4160-4d1c-89fa-91b0a4e7071d req-f151c5bd-a648-4345-ab4a-2b191508ae12 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:26.141529 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [req-2e3b60b4-4160-4d1c-89fa-91b0a4e7071d req-f151c5bd-a648-4345-ab4a-2b191508ae12 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:26.152437 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.compute.server_external_events [req-2e3b60b4-4160-4d1c-89fa-91b0a4e7071d req-f151c5bd-a648-4345-ab4a-2b191508ae12 service nova] Creating event network-vif-plugged:b4ddffb5-c594-4396-8d6b-9b3aceafede4 for instance 648987d6-d2c1-4198-b652-2ba2b1d7c205 on hv-cinder-82635 Jan 27 16:21:26.158291 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [req-2e3b60b4-4160-4d1c-89fa-91b0a4e7071d req-f151c5bd-a648-4345-ab4a-2b191508ae12 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172662 Jan 27 16:21:26.159167 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 796/1584] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:21:26.175779 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:26.183945 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-79f08695-d563-4dc3-8a33-71bf475f79a5 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.413972 Jan 27 16:21:26.184698 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 789/1585] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:25 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:27.202007 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:27.202700 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:27.208936 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:27.209388 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:27.210162 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:27.210608 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:27.342319 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:27.349647 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-587613d1-a475-41b5-ada5-ceec146d8877 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1265 microversion: 2.1 time: 0.152129 Jan 27 16:21:27.350336 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 797/1586] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:27 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:28.365742 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:28.366351 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:28.372708 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:28.373166 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:28.373953 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:28.374422 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:28.509314 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:28.517213 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c396cd45-0f74-42c2-aa98-3b7fa6d27a80 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1452 microversion: 2.1 time: 0.155228 Jan 27 16:21:28.518626 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 790/1587] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:28 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:28.535588 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:21:28.536476 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:21:28.543005 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:28.543478 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:28.544271 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:28.544711 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:28.681788 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:21:28.689735 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-83662e93-cbbe-435e-b623-7c0784b32096 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1452 microversion: 2.1 time: 0.157903 Jan 27 16:21:28.690303 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 798/1588] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:21:28 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:21:30.445439 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-8a2ad025-f6dc-45e3-9142-aa5c6cc5746e req-b41ccc0a-0f53-4e8a-acbc-303e386b8b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648987d6-d2c1-4198-b652-2ba2b1d7c205", "tag": "b4ddffb5-c594-4396-8d6b-9b3aceafede4"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:21:30.446766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:21:30.446766 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:21:30.454601 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-8a2ad025-f6dc-45e3-9142-aa5c6cc5746e req-b41ccc0a-0f53-4e8a-acbc-303e386b8b0b service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:21:30.455078 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-8a2ad025-f6dc-45e3-9142-aa5c6cc5746e req-b41ccc0a-0f53-4e8a-acbc-303e386b8b0b service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:21:30.468843 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-8a2ad025-f6dc-45e3-9142-aa5c6cc5746e req-b41ccc0a-0f53-4e8a-acbc-303e386b8b0b service nova] Creating event network-changed:b4ddffb5-c594-4396-8d6b-9b3aceafede4 for instance 648987d6-d2c1-4198-b652-2ba2b1d7c205 on hv-cinder-82635 Jan 27 16:21:30.474299 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-8a2ad025-f6dc-45e3-9142-aa5c6cc5746e req-b41ccc0a-0f53-4e8a-acbc-303e386b8b0b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032536 Jan 27 16:21:30.474969 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 791/1589] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:21:33.029027 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:21:33.029646 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:21:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:23:10.375966 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:23:10.376536 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:23:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:23:20.864485 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:20.865862 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: ERROR oslo.messaging._drivers.impl_rabbit [-] [af9a4c31-3ec7-4447-8377-f26961c43aa8] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 27 16:23:20.867525 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:20.869992 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-b5c808dc-f5d3-43c4-8c88-a0f245a1a07f req-9c51f9c7-411d-4391-8476-5bee42815d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648987d6-d2c1-4198-b652-2ba2b1d7c205", "tag": "b4ddffb5-c594-4396-8d6b-9b3aceafede4"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:23:20.871602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:23:20.871602 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:23:20.874696 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:20.875279 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:20.876513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:20.877101 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:20.880819 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-b5c808dc-f5d3-43c4-8c88-a0f245a1a07f req-9c51f9c7-411d-4391-8476-5bee42815d35 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:20.882725 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-b5c808dc-f5d3-43c4-8c88-a0f245a1a07f req-9c51f9c7-411d-4391-8476-5bee42815d35 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:20.893799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-b5c808dc-f5d3-43c4-8c88-a0f245a1a07f req-9c51f9c7-411d-4391-8476-5bee42815d35 service nova] Creating event network-changed:b4ddffb5-c594-4396-8d6b-9b3aceafede4 for instance 648987d6-d2c1-4198-b652-2ba2b1d7c205 on hv-cinder-82635 Jan 27 16:23:20.901046 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-b5c808dc-f5d3-43c4-8c88-a0f245a1a07f req-9c51f9c7-411d-4391-8476-5bee42815d35 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036800 Jan 27 16:23:20.902132 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 792/1590] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:23:20.907955 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:23:21.004367 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-2122949c-b22f-406b-927f-e8e9048db497 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "DELETE /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 204 len: 0 microversion: 2.1 time: 0.143812 Jan 27 16:23:21.007060 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 799/1591] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:23:20 2022] DELETE /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:23:21.015817 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:21.016524 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:21.022900 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:21.023404 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:21.024366 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:21.024799 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:21.229279 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:23:21.238615 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-8a3b301f-5afa-43a7-8fd9-60ef73273e86 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1577 microversion: 2.1 time: 0.228202 Jan 27 16:23:21.239418 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 793/1592] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:21 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:23:22.256930 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:22.257540 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:22.263960 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:22.264409 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:22.265189 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:22.265620 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:22.455337 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:23:22.462600 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-d440b4db-8952-4b5d-8d45-a072252ab2a4 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1458 microversion: 2.1 time: 0.210060 Jan 27 16:23:22.463191 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 800/1593] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:22 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1458 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:23:23.352266 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-f2a4eccf-571b-4559-b4f9-21f0a155994e req-efc9c5d7-22ac-45e3-b86f-973cd1cd3ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648987d6-d2c1-4198-b652-2ba2b1d7c205", "name": "network-vif-deleted", "tag": "b4ddffb5-c594-4396-8d6b-9b3aceafede4"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:23:23.353845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:23:23.353845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:23:23.367125 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] [af9a4c31-3ec7-4447-8377-f26961c43aa8] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 43028. Jan 27 16:23:23.372455 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-f2a4eccf-571b-4559-b4f9-21f0a155994e req-efc9c5d7-22ac-45e3-b86f-973cd1cd3ddd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:23.372902 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-f2a4eccf-571b-4559-b4f9-21f0a155994e req-efc9c5d7-22ac-45e3-b86f-973cd1cd3ddd service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:23.386079 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-f2a4eccf-571b-4559-b4f9-21f0a155994e req-efc9c5d7-22ac-45e3-b86f-973cd1cd3ddd service nova] Creating event network-vif-deleted:b4ddffb5-c594-4396-8d6b-9b3aceafede4 for instance 648987d6-d2c1-4198-b652-2ba2b1d7c205 on hv-cinder-82635 Jan 27 16:23:23.391855 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-f2a4eccf-571b-4559-b4f9-21f0a155994e req-efc9c5d7-22ac-45e3-b86f-973cd1cd3ddd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043248 Jan 27 16:23:23.392625 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 794/1594] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:23:23.479636 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:23.480231 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:23.486807 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:23.487294 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:23.488082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:23.488521 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:23.553849 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:23:23.561795 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-fd872d86-0baa-406c-a49c-8c8378925f58 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 200 len: 1225 microversion: 2.1 time: 0.085881 Jan 27 16:23:23.562356 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 801/1595] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:23 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:23:24.579395 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:24.580087 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: 648987d6-d2c1-4198-b652-2ba2b1d7c205] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:24.586576 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:24.587056 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:24.587842 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:24.588280 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:24.601783 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] HTTP exception thrown: Instance 648987d6-d2c1-4198-b652-2ba2b1d7c205 could not be found. Jan 27 16:23:24.602380 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Returning 404 to user: Instance 648987d6-d2c1-4198-b652-2ba2b1d7c205 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:23:24.603237 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-c11a9660-5c8e-4a87-82ce-8d6b90e8eeb9 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205" status: 404 len: 111 microversion: 2.1 time: 0.028405 Jan 27 16:23:24.603827 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 795/1596] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:24 2022] GET /compute/v2.1/servers/648987d6-d2c1-4198-b652-2ba2b1d7c205 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:23:27.698776 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-753ab9e1-c722-439f-9910-1bc8f8a0c556 req-5353b4b6-61b2-4f27-a0db-9d0d6cd6f70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ca1cd3-ba62-49ad-8347-94440c81f23e", "tag": "96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:23:27.704513 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:27.705082 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:27.708419 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:23:27.708419 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:23:27.716387 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:27.717127 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:27.717277 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-753ab9e1-c722-439f-9910-1bc8f8a0c556 req-5353b4b6-61b2-4f27-a0db-9d0d6cd6f70f service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:27.717614 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-753ab9e1-c722-439f-9910-1bc8f8a0c556 req-5353b4b6-61b2-4f27-a0db-9d0d6cd6f70f service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:27.717913 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:27.718346 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:27.729152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-753ab9e1-c722-439f-9910-1bc8f8a0c556 req-5353b4b6-61b2-4f27-a0db-9d0d6cd6f70f service nova] Creating event network-changed:96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d for instance e9ca1cd3-ba62-49ad-8347-94440c81f23e on hv-cinder-82635 Jan 27 16:23:27.734871 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-753ab9e1-c722-439f-9910-1bc8f8a0c556 req-5353b4b6-61b2-4f27-a0db-9d0d6cd6f70f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039562 Jan 27 16:23:27.738735 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 796/1597] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:23:27.748718 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Going to try to terminate instance {{(pid=116260) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:23:27.836675 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-268364c2-8c8c-441a-b574-ad18c09746ae tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 204 len: 0 microversion: 2.1 time: 0.143339 Jan 27 16:23:27.837701 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 802/1598] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:23:27 2022] DELETE /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:23:27.850457 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:27.852413 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:27.863245 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:27.864059 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:27.865756 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:27.866552 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:28.041663 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.policy [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116261) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:23:28.050514 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-03b85094-571f-4c14-b91a-3a10b8413210 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1578 microversion: 2.1 time: 0.207776 Jan 27 16:23:28.051131 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 797/1599] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:27 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:23:29.122280 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:29.122969 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:29.129639 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:29.130087 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:29.130863 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:29.131321 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:29.276325 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:23:29.284422 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-e4663626-0fc5-4d46-9b18-ebc36a279dcf tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1460 microversion: 2.1 time: 0.166729 Jan 27 16:23:29.284998 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 803/1600] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:29 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1460 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:23:29.983544 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [req-29a12456-4475-493b-8289-1def2cbd92a9 req-f35d102a-a834-4a00-81b9-c91198ff1b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ca1cd3-ba62-49ad-8347-94440c81f23e", "name": "network-vif-deleted", "tag": "96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d"}]} {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:23:29.985322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:23:29.985322 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: warnings.warn(msg) Jan 27 16:23:29.994515 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-29a12456-4475-493b-8289-1def2cbd92a9 req-f35d102a-a834-4a00-81b9-c91198ff1b11 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:29.994963 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [req-29a12456-4475-493b-8289-1def2cbd92a9 req-f35d102a-a834-4a00-81b9-c91198ff1b11 service nova] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:30.006672 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.compute.server_external_events [req-29a12456-4475-493b-8289-1def2cbd92a9 req-f35d102a-a834-4a00-81b9-c91198ff1b11 service nova] Creating event network-vif-deleted:96aeaa0d-beb4-48d1-9536-b3ac0ee44c1d for instance e9ca1cd3-ba62-49ad-8347-94440c81f23e on hv-cinder-82635 Jan 27 16:23:30.011687 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [req-29a12456-4475-493b-8289-1def2cbd92a9 req-f35d102a-a834-4a00-81b9-c91198ff1b11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Jan 27 16:23:30.012845 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 798/1601] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jan 27 16:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:23:30.306230 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:30.306886 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:30.318225 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:30.318690 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:30.319539 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:30.319975 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:30.354557 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:30.355032 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:30.355699 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.objects.instance [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lazy-loading 'fault' on Instance uuid e9ca1cd3-ba62-49ad-8347-94440c81f23e {{(pid=116260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:23:30.397342 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.policy [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f28c63ddb848b4b5e948bb30e4f6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3984d8f6dc40258844819aa562633f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116260) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:23:30.405047 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-0feca018-0dd7-44d0-b377-2c5dea51b105 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 200 len: 1231 microversion: 2.1 time: 0.107056 Jan 27 16:23:30.405628 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 804/1602] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:30 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:23:31.422798 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:31.423610 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e9ca1cd3-ba62-49ad-8347-94440c81f23e] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:31.429608 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:31.430045 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:31.430822 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:31.431285 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:31.445384 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] HTTP exception thrown: Instance e9ca1cd3-ba62-49ad-8347-94440c81f23e could not be found. Jan 27 16:23:31.445960 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Returning 404 to user: Instance e9ca1cd3-ba62-49ad-8347-94440c81f23e could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:23:31.446775 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-37524750-17ca-4eef-b95e-bf8b687a5f20 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e" status: 404 len: 111 microversion: 2.1 time: 0.028442 Jan 27 16:23:31.447321 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 799/1603] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:31 2022] GET /compute/v2.1/servers/e9ca1cd3-ba62-49ad-8347-94440c81f23e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:23:31.903491 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:31.904059 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.compute.api [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116260) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:31.910290 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:31.910828 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:31.911651 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:31.912094 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG oslo_concurrency.lockutils [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:31.928565 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.wsgi [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] HTTP exception thrown: Instance e809722e-dbfd-42d6-8563-74ca78108388 could not be found. Jan 27 16:23:31.929070 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Returning 404 to user: Instance e809722e-dbfd-42d6-8563-74ca78108388 could not be found. {{(pid=116260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:23:31.929899 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-25a9f823-2554-4683-87d8-26cd1f6a619b tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 404 len: 111 microversion: 2.1 time: 0.030157 Jan 27 16:23:31.930446 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 805/1604] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jan 27 16:23:31 2022] DELETE /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:23:31.939221 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '>' {{(pid=116261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:31.939833 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.compute.api [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] [instance: e809722e-dbfd-42d6-8563-74ca78108388] Fetching instance by UUID {{(pid=116261) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:23:31.945805 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:31.946258 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:31.947085 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:23:31.947522 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG oslo_concurrency.lockutils [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Lock "d846773d-1586-4f37-a106-5bfdc77828fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:23:31.961028 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.wsgi [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] HTTP exception thrown: Instance e809722e-dbfd-42d6-8563-74ca78108388 could not be found. Jan 27 16:23:31.961617 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: DEBUG nova.api.openstack.wsgi [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Returning 404 to user: Instance e809722e-dbfd-42d6-8563-74ca78108388 could not be found. {{(pid=116261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:23:31.962473 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO nova.api.openstack.requestlog [None req-dfbd5156-6516-4251-a448-a37bf7cf58ac tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388" status: 404 len: 111 microversion: 2.1 time: 0.026888 Jan 27 16:23:31.963038 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: [pid: 116261|app: 0|req: 800/1605] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jan 27 16:23:31 2022] GET /compute/v2.1/servers/e809722e-dbfd-42d6-8563-74ca78108388 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:23:33.239350 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: DEBUG nova.api.openstack.wsgi [None req-82ea40a7-a222-4d58-8ffb-f05576f24d81 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] Calling method '.version_select at 0x7f78173acf70>' {{(pid=116260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:23:33.260868 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO nova.api.openstack.requestlog [None req-82ea40a7-a222-4d58-8ffb-f05576f24d81 tempest-TestVolumeBootPattern-935354243 tempest-TestVolumeBootPattern-935354243-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1991526380" status: 202 len: 0 microversion: 2.1 time: 0.025100 Jan 27 16:23:33.261556 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: [pid: 116260|app: 0|req: 806/1606] 10.222.0.61 () {58 vars in 1262 bytes} [Thu Jan 27 16:23:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1991526380 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:24:29.501774 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:24:29.502662 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:24:53.039309 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:24:53.040009 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:24:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:26:21.782393 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:26:21.783179 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:26:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:26:30.384152 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:26:30.384716 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:26:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:26:36.848684 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:26:36.849302 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:26:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:26:39.006969 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:26:39.007574 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:27:49.510440 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:27:49.511723 dv-cinder-826350-3-iscsi devstack@n-api.service[116261]: Thu Jan 27 16:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:28:13.047362 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:28:13.048024 dv-cinder-826350-3-iscsi devstack@n-api.service[116260]: Thu Jan 27 16:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!